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PREFACE 


This treatise is addressed to a reader who has already acquired some 
proficiency in the technique of the calculus and who desires a more logi¬ 
cal treatment of the subject than is feasible in a first course. It is 
suitable as a text for upper classmen, particularly those in reading or 
honors classes, and for graduate students. It may also prove a con¬ 
venience to teachers in that it includes in a single volume proofs of a 
number of theorems which are usually assumed without proof in ele¬ 
mentary textbooks. 

While the book deals primarily with infinitesimal calculus, prerequisite 
parts of algebra and analysis and concepts needed for applications to 
geometry and physics have not been excluded. Thus the real number 
system, complex numbers, limits, continuous functions and infinite 
series, products and sequences are discussed as necessary preliminaries. 
Adequate definitions of the elementary functions are also given. For 
the trigonometric functions, the arithmetic definition given here is 
believed to be new in detail, although in principle it goes back to 
Ptolemy. Unlike definitions based on integrals or series, it avoids giv¬ 
ing the student the impression that trigonometry is dependent on inte¬ 
gration or function theory. The treatment permits the introduction of 
the trigonometric functions at an early stage. Similarly, the Gauss 
proof of the fundamental theorem of algebra makes possible the pres¬ 
entation of the decomposition of rational functions into partial fractions 
before integration. 

The'presentation of differentiation is complete in itself, with the 
elementary derivations briefly recapitulated. This frees the work 
from dependence on any particular first course. Taylor’s developments 
and indeterminate forms are studied at length. Several properties of 
Taylor’s series are derived later by using analytic functions. An exist¬ 
ence theorem for implicit functions is established in connection with 
partial differentiation. The statements of the relations of Jacobians to 
solvability and functional dependence avoid a common error resulting 
from the confusion of the term “ vanishing ” with “ identically vanish- 
' ing.” The existence theorems for ordinary and first-order partial 
differential equations, generally omitted from the formal course in 
differential equations, are demonstrated. The theory of envelopes is 
introduced as an application of the condition for a differential equation 
to have a unique solution. Analytic functions of several complex vari- 
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rite » detoed, and it is shown that the total differentiation rule 

“'fc^tfcTu treated in several of its aspect*. The subject bepn. 
JK integration of continW functions and deals with migration 
to explicit terms. A rough clarification of those mtograls which are 
reducible to elementary functions is given. As among the -mplest non. 
elementary integrals, elhptic integrals are defined and proved to be 
reducible to a combination of elementary functions and Legendres 
three normal fo rms . The discussion of the Riemann integration of 
bounded functions includes Lebesgue’s condition, as well as those of 
Darboux and Jordan. With a view to physical applications, a simple 
type of Stieltjes integral is discussed. Multiple integrals and their 
relation to repeated integrals are treated. Satisfactory definitions of 
arc length, surface area, and such mechanical concepts as center of 
gravity and moment of inertia of continuous distributions are formu¬ 
lated. 


The discussion of the theory of functions, Fourier series, and Fourier 
and Laplace transforms is facilitated by a preliminary chapter on uni¬ 
formity and other conditions for the inversion of limit processes. So 
much of the theory of functions is given as is necessary for the computa¬ 
tion of definite integrals by the method of residues. Several of the 
better known definite integrals capable of evaluation by the use of 
Fourier transforms, residues, or inversion of order in repeated integrals 
are given in the exercises. Because of the large number of particular 
definite integrals reducible to, or related to, the Gamma function, this 
function forms the subject of a special chapter. Here many asymptotic 
expansions are developed, including that of Stirling. This is established 
for complex, as well as for real, values of the argument. 

My primary object has been to provide a sound foundation for the 
methods of the calculus. However, enough theory has been included 
so that the student who has thoroughly mastered this book will be well 
prepared to pursue graduate work in analysis. A selected list of refer¬ 
ences for further study, topically arranged, is given in the bibliography. 

The number of problems is large. Many of them concern fairly 
general forms. It is assumed that numerical problems can easily be 
constructed from these forms by any reader or teacher who feels the need 
of them. Hints for their solution, in many cases amounting to the 
solution in outline, are appended whenever any real difficulty is involved 
or when the method of proof, using only the material of preceding 
chapters, is not easy to see. A few of the problems contain important 
results, and the name of the discoverer is mentioned. For instance, 
Peano’s example of a continuous function nowhere differentiable and 
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Fej^r’s example of a continuous function whose Fourier series diverges 
appear as exercises. 

The principal works which I have consulted in preparing the text and 
the problems are included in the bibliography. I have found Hardy’s 
Pure Mathematics and de la Vall6e Poussin’s Cours d’Analyse especially 
helpful. I also owe much to discussions with colleagues and students. 


Cambridge, Mass. 
January , 1940 


Philip Franklin 
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CHAPTER I 

REAL NUMBERS 

We assume that the reader is already acquainted with the rules of 
reckoning for positive and negative numbers, as well as the use of such 
numbers as coordinates to determine points on a line or in a plane. 
However, certain abstract properties of numbers or of points in one or 
more dimensions may be unfamiliar to the reader. To lead up to these 
properties, we shall sketch one method of starting with the positive 
integers and logically developing the complete system of positive and 
negative, rational and irrational numbers. 

1. Mathematical Induction. The positive integers are the numbers 
used in counting, 1,2, 3, ■ • • . We assume that their elementary proper¬ 
ties are known. In particular, an integer n is less than n if, and only if, 
there is a positive integer k such that n' - n + k. In this case n is 
greater than n. 

In any finite, non-empty collection of integers there is a greatest 
integer and a least integer. By non-empty, we mean that the collec¬ 
tion contains at least one integer. By greatest integer, we mean one 
greater than, or equal to, any other integer of the collection. The defini¬ 
tion of least integer is similar. 

If each of the members of I, an infinite collection of positive integers, is 
less than, or equal to, N, every integer of the collection I is equal to some 
member of the finite collection 1, 2, • • • N. Thus there is a finite collec¬ 
tion of distinct integers, F, such that each member of I is equal to a 
member of F. The greatest integer of F is the greatest of I, so that the 
first collection 1 has a greatest integer. 

Again, if an infinite collection of positive integers contains the integer 
N, the integers of the collection less than, or equal to, N determine a 
finite collection of distinct integers. If M is the least of these, then M 
is less than, or equal to, all the integers in the collection which do not 
exceed N. But, since M is less than N + 1, it is less than all those 
integers in the collection which do exceed N. Thus the original infinite 
collection has a least number M 

1 
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It follows that any non-empty collection of positive integers contains 
a least integer. This has as a consequence the principle of mathematical 
induction, which is often useful. We may express it as a theorem: 

If the statement of a theorem involves a positive integer n, and if the 
theorem for any particular value of n implies the theorem for the value 
n + 1 , then the truth of the theorem for the value 1 implies its truth for all 
positive integral values of n. 

To prove this, let S(n) denote the statement of the theorem involving 
the particular value n. Then consider the collection of positive integers 
m, such that the statement Sim) is false. If there is at least one integer 
to, there will be a least integer in this collection. Call this integer k. 
Since the theorem <S(1) is true, and the theorem S(k) is false, k cannot 
be 1. Therefore, there is a positive integer k — 1 which precedes k in the 
natural order. 

Since every value m equals or exceeds k, the integer k — 1 is not a 
value to. Therefore the statement S(k — 1) is true, and by the assumed 
nature of S(n), this implies that the theorem S(k) is true. Thus we 
arrive at a contradiction, which shows that the assumption that there 
was at least one integer m was false. Since the statement S(n) is false 
for no positive integral values, it is true for all such values. 

2. Rational Numbers. In discussing the rational numbers, we take 
the positive integers and the rules for their addition and multiplication 
as our starting point. Division is defined as the inverse of multiplica¬ 
tion. That is: 



if 


bx = a. 


(V 


When we restrict ourselves to the positive integers, division is not always 
posable since there may iot be any integer x which satisfies the second 
equation for a given pair of integers a and b. 

To overcome this difficulty, we introduce the positive rational num¬ 
bers. These are defined in terms of pairs of positive integers. We 
define equality of two rational numbers by the rule: 

t 

7 = ry if ah' = a'b. (2) 

o 0 

We identify certain rational numbers with integers by regarding 

a 


(3) 
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Addition and multiplication are defined*by the rules 

a a' ah' + a'b 

b T 6' bb' 


bb'~W w 

Subtraction is defined as the inverse of addition. That is, 
a a' ..a' , a 

z~v mx * v +x ~v (6) 

If the integer ab 1 exceeds a'b, there is a rational value of x, 

ab' - a'b 

x - ~w~ m 

which satisfies the second equation (6), but if ab' does not exceed a'b, 
there is no positive rational value of x which satisfies this equation (6). 

To overcome this difficulty, we introduce zero and the negative rational 
numbers. The rules for combining zero with an integer in the case of 
addition and multiplication are: 

a + 0 = a, a • 0 = 0. (8) 

We indicate negative integers by positive integers with a minus sign 
affixed and define addition for them by such rules as 

a + (—6) = a — b = — (?) — a), etc. (9) 

Multiplication of positive and negative integers is defined by such rules 
as 

a(—b) = —ab, (—a)( —6) = ab, etc. (10) 

We indicate negative rational numbers in Jny one of three ways, 
identifying 


b -b 


We also agree to consider 


Cert a in rational numbers are identified with negative integers by the 
convention that 


(13) 
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We then extend the application of equations (1) through (6) to the 
ease where a and a' are positive or negative integers or zero and where 
b and b f are positive or negative integers, equations (8) through (12) 
being used when necessary. We thus find that the relations (8) through 
(10) hold when a and b are replaced by any positive or negative rational 
numbers. They will also hold if a or b is replaced by zero and the other 
is replaced by a rational number, provided we extend the application of 
equations (8) through (10) to the case where a or b or both are zero. 
We extend equations (11) and (12) to the case where a is zero and b is 
not zero, but we do not define division by zero or admit rational frac¬ 
tions with zero as denominator. 

The positive and negative rational numbers together with zero consti¬ 
tute the rational number system . The system includes the positive and 
negative integers by the conventions made in equations (3) and (13). 

Addition and multiplication when applied to positive integers satisfy 
the commutative laws: 

a + b = b + a, ab — ba, (14) 

the associative laws: 

a + (b + c) = (a + b) + c, a (be) = (afc)c, (15) 

and the distributive law: 

a(b + c) = ab + ac . (16) 

We extend these by definition to the case in which a and b are positive 
or negative integers or zero. These laws then necessarily hold for any 
numbers of the rational number system in view of our earlier definitions. 

We note that, in the rational number system, multiplication, addition, 
and subtraction are always possible. Division is possible except when 
the divisor is zero. 

We indicate that a rational number is positive by writing 

r > 0. (17) 

This enables us to introduce order into the rational number system. We 
do this by writing 

r f > r or r <r r if r f — r > 0. (18) 

In particular, if r > 0, — r < 0. Also 

r f > r implies — / < — r. (19) 

For any two unequal rational numbers, equation (18) determines which 
precedes and which follows. However, unlike the set of integers, there 
is no next greater rational number to any given one, in the way that 3 is 
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the next greater integer to 2. In fact, we may always insert one rational 
number, and hence as many as we please, between any two unequal 
rational numbers. 

The positive integers, in their natural order, are enumerated, and 
any collection of numbers or objects which can be arranged in a single 
sequence with a first, second, • • •, nth object is said to be enumerable. 
The collection of rational numbers is enumerable, since there are only a 
finite number of rational fractions a/b with |o| -f |fcj = N. Here |o| 
means the numerical value of a, that is, a if a is positive and —a if a is 
negative. Thus we may take a series of blocks of terms, for which 
N = 1 , 2, • • • in succession. The first few terms are: 

0; 1» — lj 2, ■§■, —2, ~ 2 ; 3, 3 , —3, — •§; 

4, b f. -4, -f, -f, -i; • • • • 

The terms in each block are arranged according to decreasing numerator 
for the positive term, followed by the corresponding negative terms. 
Any number is omitted from the sequence if an equal number has been 
already listed. 

3* Irrational .Numbers. Irrational numbers, and operations with 
irrational numbers, may be defined in terms of classes of rational num¬ 
bers in a way similar to the definition of rational numbers in terms of 
pairs of integers. We begin by defining a cut in the system of rational 
numbers as a separation of the rational number system into two classes, 
A and B, with the following properties: 

Pl. Every number in A, the left-hand class, precedes every number in B, 
the right-hand class. 

P 2 . There are some numbers in each class. 

P3. Each number of the rational number system is in one of the two 
classes. 

Let us denote by a or a t typical rational numbers of class A, and simi¬ 
larly by b or 6 * typical elements of class B. It follows from the properties 
PI and P3 that every number less than any one a is in A. Similarly, 
every rational greater than any one b is in B. There may be a rational 
number, c , such that for all the elements a and b , 

a ^ c £ b. ( 20 ) 

In this case, we say that the cut is rational, and identify the rational 
number c with it. By the property P3, c is in one of the classes. But, 
by equation (20), if it is in A, it is the last number in A and if it is in B, 
it is the first number in B. There cannot be two distinct rational 
numbers c satisfying the relation ( 20 ) for all a and 6 , since if c 9 were a 
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second such number, numbers between c and c' would have to belong to 
both classes. Hence as examples of rational cuts, for each of which 
c = 3, we may have: 


x in A, if x < 3; 

x in B, if x (£ 3, 

(21) 

* in A, if x 3; 

x in B, if x > 3. 

(22) 


However, for a given cut, there may not be any rational number c 
which satisfies the relation (20). In this case, we say that the cut is 
irrational and regard the cut itself as the definition of an irrational 
number y. We define y as following all the numbers in A, and preceding 
all those in B, so that for all elements a and b, 

a < y < b. (23) 

As an example of an irrational cut, we have 

x in A if either x < 0 or x 2 < 3; 
x in B if x > 0 and also x 2 > 3. 

When multiplication is defined for irrational numbers, we shall see that 
the y for this cut has y 2 — 3, so that this cut defines V3. 

Two irrational numbers y and y' are equal if the elements of A are all 
elements of A' and if the elements of B are all elements of B'. If the 
irrational numbers y and y' are not equal, there are two possibilities. 
Either some element of A, a is an element of B', b', in which case 

y' < b' - a < y and y' < y, (24) 

or some element of B, b is an element of A', a', in which case 

y <b = a' < y’ and y < y’. (25) 

Thus the natural order of precedence of two irrational numbers is 
determined. For a pair of numbers, one of which is rational and one of 
which is irrational, the order of precedence is determined by the cut 
defining the irrational number in accordance with the relation (23). 

The rational and irrational numbers together make up the real number 
system. 

4. Real Numbers. It follows from our definition that every cut in 
the system of rational numbers with the properties PI, P2, P3 determines 
a angle real number. It is often desirable to replace P3 by an alterna¬ 
tive property: 

P3'. Given any positive real number e, it is possible to find a number a of 
the does A and a number b of the class B such that b - a is at most e. 
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The property P3' is of such a nature that if it holds for a particular e, 
it will necessarily hold for any larger value of e. Thus in most applica¬ 
tions of P3' we shall be concerned with small values of e. Again, for 
any given irrational positive number, we may find a smaller rational 
positive number. Consequently, to show that P3' holds, it will only be 
necessary to show that it holds for rational values of e. 

We shall now show that any cut satisfying the properties PI, P 2 , P3 
also has the alternative property P3'. Let a x be any element belonging 
to class A for the given cut, and consider any rational value of e for 
which we desire to test P3'. Form the sequence 

Hi, Oi + 2e, • ■ • , di -f- Ne. (26) 

If t>i is any element of class B, and we take N large enough, the last 
number of the sequence, a x + Ne, will exceed £>i and hence will itself be 
a member of class B. Thus the elements of the sequence (26) will be in 
A, up to a certain one, a x + ne, and from there on they will be in B. 
Consequently, the property P3' may be satisfied for the e considered by 
taking 

a = «i + ne, b = Oj + (n 4 - 1)«, b — a = e. (27) 

We next show that any cut satisfying the properties PI, P 2 , P3' 
determines a single real number. Let A' and B' denote the two classes 
for the given cut. We replace class A' by an enlarged class A, which 
contains not only all the elements of A' but all the rational numbers less 
than any number in A'. Similarly we enlarge the class B' to a class B 
containing all the rational numbers greater than any element of B' as 
well as all the elements of B / . 

If the enlarged classes A and B include all the rational numbers, P3 
is satisfied and a real number is defined. 

If the enlarged classes include all the rational numbers except one, r, 
this number must be greater than all the elements of A and less than all 
the elements of B. Consequently, if we add r to the class A, we have a 
cut defining the rational number r. 

Finally, suppose that at least two distinct rational numbers r and r' 
are not included in the enlarged classes A and B. Then, for any ele¬ 
ments a of A and b of B, we would have: 

a < r, b > r', (28) 

where r' is taken as the greater of the two. Hence 

b — a > r' — r, (29) 

since b — a — (/ — r) =* (b — r') + (r — a) is positive. But, since 
r' > r, / — r is positive and we may take it as the t of the property P3'. 
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We thus obtain a pair of elements a of A' and hence of A, b of B' and 
hence of B, for which 

b — a £ e, or b — a £ r' — r. (30) 

Ab this contradicts the relation (29), the possibility of there being more 
than one rational number omitted from the classes A and B is excluded. 

Since a cut which has the properties PI, P2, P3 also has the property 
P3', while a cut with the properties PI, P2, P3 / may be modified to give 
a cut with the property P3, we usually consider a given cut which 
determines a real number as having all four properties: PI, P2, P3, P3'. 
However, in constructing a cut to determine a new real number, it is 
only necessary to establish PI, P2, and either P3 or P3'. We shall fre¬ 
quently find P3' the more convenient. 

6. Operations on Real Numbers. If two given real numbers y and 
y' are defined by cuts, and if we denote typical elements so that: 

a g y ^ 6, a' <; y' g, b', (31) 

the sum of the numbers y and y' is defined by requiring that: 

a + a' g y + y' ^ b + b' (32) 

for all choices of a, b, a', b r . 

Since the property PI holds for the two given cuts, the equality cannot 
take place in both cases in either of the relations (31). Hence for all 
choices, a -f- a' < b + b' } and the cut with all sums a + a' in class A 
and with all sums b + b' in class B will satisfy the property PI. 

The property P2 will obviously hold for the new cut if it holds for the 
original cuts. 

Finally, from property P3' applied to the two original cuts, we may 
find pairs a, b and a', b' such that: 

i - a | ft, b' — a' :£ Je, "(33) 

where e is any positive quantity. It follows from this that 

(b + b') - (a + a') - (b - a) + ( b ' - a ') ^ e. (34) 

Thus the new cut satisfies the property P3', as well as the properties 
PI and P2, and so defines a single real number. 

By extending the application of the second equation (8) and the 
equation (10) to real numbers, we may reduce the multiplication of real 
numbers to the multiplication of positive numbers. For two positive 
real numbers, we put: 

aa' < yy' S. bb', if y > 0, y' > 0. 


(35) 
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By an argument similar to that used in the case of addition, we may 
show that this leads to a cut satisfying the properties PI, P2, and P3' 
and hence defines a single real number. 

In deducing the products of negative real numbers from the products 
of the corresponding positive numbers, we need a method of finding the 
cut for — y when that for y is given. If a and b are typical elements of 
the cut for y , as in the relation (31), —b and —a are typical elements 
of the cut for — j/, since: 

-b g -y g -a. (36) 

This relation also enables us to define subtraction by the relation: 

y' - y = y'+ i-y). (37) 


To define division, we first define the reciprocal of a positive number y 
by using only the elements a which are positive. We use a subscript p 
to indicate the restriction to positive elements. Then we put: 


7 ^ ~ ^ — 9 if y > 0, where a v > 0. (38) 

b y a p 

We then define the reciprocal of a negative number by 


1 1 

-y y 

and finally define division by 



(39) 


(40) 


We may show that the cut given by the relation (38) leads to a single 
real number, by showing that the properties PI, P2, and P3' hold. 

The definitions of the four fundamental operations for real numbers 
given in this section are in agreement with all our earlier rules. In 
particular, we continue to have subtraction the inverse of addition and 
division the inverse of multiplication. 

6. Cuts in the Real Number System. It is a natural extension of our 
previous definition to consider as a cut in the real number system any 
separation of the real numbers into two classes A and B if it satisfies 
the three properties: 

Rl. Every number in A, the left-hand class , precedes every number in B, 
the right-hand class . 

R2. There are some numbers in each class . 

R3. Each number of the real number system is in one of the two classes 
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These statements differ from the corresponding ones of section 3 only 
in having rational replaced by real in R3 and in having the word number 
mean real number instead of rational number. 

We shall show that for cuts in the real number system there is always 
a real number which makes the separation. We first observe that the 
separation of the real numbers which satisfies the properties Rl, R2, R3 
involves a separation of the rational numbers which satisfies the proper¬ 
ties PI, P2, P3. This cut defines a single real number y. If ai is any 
rational element of A, and bi is any rational element of B, we shall have: 

ai ^ V £ h- (41) 

Again, if a is any irrational number less than y, there are rational 
numbers between a and y. Let «i be one of them. Then 

a < ai < y, (42) 

and since ai is in A, a is also in A. Similarly, any irrational number 
greater than y is in B. Thus for all real numbers a in A and b in B, and 
the y defined by the relation (41), we must have: 

a ^ y ^b, (43) 

With one of the equality signs holding for y itself, which must be in one 
class or the other, in view of the property R3. 

Thus cuts in the real number system bear the same relation to that 
system that rational cuts bear to the system of rational numbers. In 
particular, cuts in the real number system do not lead to any new 
numbers. These results are expressed in the theorem of Dedekind: 

Every cut in the real number system satisfying the 'properties Rl, R2, R3 
is effected by a unique real number. 

By using the results of section 4, we may show that all the conclusions 
of this section continue to hold if we replace R3 by the alternative R3 / : 

R3 / . Given any positive real number e, it is possible to find a number a 
of class A, and a number b of class B such that b — a is at most e. 

This statement does not differ in wording from P3 but differs slightly 
in intent, since the o and b of R3' may be irrational. However, it is not 
difficult to show that if irrational values can be found, rational ones can 
also be found with 6 — a at most«, for any given positive e. 

7. Geometric Representation. If we take a straight line, regarded 
as indefinitely extended in both directions, we may match up its points 
with real numbers, coordinates of the points, in the following way. We 
select one point as an origin, which we mark zero. We take one of the 
directions on the line as positive and mark a point one unit away from 
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the origin in this direction with one. By repeating this operation, we 
obtain the points for two, three, and the other positive integers. Points 
on the opposite side of the origin, found in a similar way, are marked 
with the negative integers. We may view the line from such a position 
that the positive is the right-hand direction and the negative is the 
left-hand direction. To suggest this image, we shall sometimes use the 
terms right and left in place of positive and negative direction. By a 
familiar construction of elementary geometry, a point for any rational 
number may be found. We take it as a geometric assumption that 
there is a single point on the line for any irrational number which sepa¬ 
rates the points with rational coordinates in the same way that the 
irrational number separates the rational numbers. We also assume 
that for each point on the line there is a single real coordinate. 

_i_i_i_■ ■ <_i_i . , i— 

-3 -2 -1 0'/4 1 VST 2 3 

Fig. 1. 

The geometric picture is helpful in following analytic arguments. 
To suggest this picture, we use an abbreviated form of language. Thus 
we speak of rational points when we mean points with rational coordi¬ 
nates. Also we use the phrase “ the point a ” in place of the expression 
“ the point with a as its coordinate.” 

By numbers x, or points x, in the interval a,b where a < b, we mean 
the coordinates of the points, or the points themselves inside the interval 
with the points a and b as end points. Thus the numbers x satisfy the 
relation: 

a < x < b. (44) 

When we wish to emphasize that the end points a and b are not included, 
we use the phrase “ points of the open interval a,b ” to mean “ those 
points x which satisfy the relation (44).” 

If we wish to include the end points a and b, we use the phrase “ points 
of the closed interval a,b ” to mean those points x which satisfy the 
relation: 

a S x ^ b. (45) 

8. Limit Points. A collection of real numbers or their correspond¬ 
ing points on a line is called a point set. A point set may have only a 
finite number of points, or it may have an infinite number of points. 
It may include whole intervals or, as an extreme case, consist of all the 
points of the coordinate axis. 

Consider a set of points, denoted by S, and a point a^sesTOsponding 
to a real number x, which may or may not belong toS. • If gvsrtfopen 
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interval which includes x includes at least one point of S different from 
x, then x is said to be a limit point of the set. It follows from this 
defini tion that every open interval which includes x contains an infinite 
number of points of S. For suppose that x is a limit point of S and 
that the open interval a,b includes x. If t/j is one point of S in the 
interval, since it is distinct from x, the point x will be included in one of 
the open intervals a,y\ or yi,b. Thus this interval will include a second 
point of S, y%, distinct from x. We may repeat this process to obtain a 
sequence of points yi, t/ 2 , 2/3, • • • , each of which is distinct from x and 
from all those which precede it. 

A limi t point of a set may or may not belong to the set. Thus the set 
consisting of the numbers 

1, 0.9, 0.99, 0.999, • • • (46) 

has 1 as a limit point and 1 as a member of the set. On the other hand, 
the set consisting of the numbers 

h h £> - ' - ( 47 ) 

has zero as a limit point, and zero does not belong to the set. 

Since every open interval includes rational points, if the set S consists 
of all the rational points of any open interval a,b, then all the points of 
the closed interval a, b will be limit points of S. 

9. Bolzano-Weierstrass Theorem. Since every open interval includ¬ 
ing a limit point of iS includes an infinite number of distinct points of S, 
it follows that a set containing only a finite number of points cannot 
have any limit points. A set may have an infinite number of points 
without having any limit points. An example is the set consisting of 
all the positive integers. That this situation cannot arise when all the 
points of the set can be included in some finite interval is the content of 
the Bolzano-Weierstrass theorem, which asserts that: 

For every set of points lying in a finite interval and having infinitely 
many elements, at least one point of the interval is a limit point. 

To prove this, consider a set S containing an infinite number of points 
all of which are included in some finite interval, say the closed interval 
0 , 6 . Define a cut in the real number system in the following manner. 
To class A, we assign a and all other numbers x such that, at most, a 
finite number of points of S have cofirdinates less than x. To class B, 
we assign b and all other numbers x' such that there is an infinite num¬ 
ber of points of S with coordinates less than x'. 

This cut satisfies the properties Rl, R2, R3 of section 6 , and there¬ 
fore, by Dedekind’s theorem, is effected by a unique real number which 
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we denote by y. If, now, x,x' is any open interval which includes y, 
then x is a number of class A and x' is a number of class B. Hence 
there are an infinite number of points of S with coordinates less than 
%', of which only a finite number can have coordinates less than x. 
Thus there must be an infinite number of points of /S in the open interval 

x, x' and therefore at least one point of S distinct from y in this interval, 
as demanded by the definition of limit point. Hence y is a limit point 
of S. 

The method of proof shows that no limit point of the set S can precede 

y. If we had begun by assigning to class A all numbers such that an 
infinite number of points of S had larger coordinates, and to class B all 
numbers such that at most a finite number of points of S had larger 
coordinates, we should have found a point y' (possibly identical with y) 
such that no limit point of the set could follow y' . This proves that: 

For every set of points lying in a finite interval and having infinitely 
many elements, there is a first limit point and also a last limit point. 

10. Bounds. If a point set on a finite interval has only a finite number 
of elements but has at least one element, there will necessarily be a first 
point and a last point. Since these are the points of the set with the 
least and the greatest coordinates, we also refer to them as the least and 
greatest elements of the set. 

If a point set £ on a finite interval contains an infinite number of ele¬ 
ments, we must have a first limit point y and a last limit point y', as 
shown in the preceding section. The set of points S may, or may not, 
include elements to the left of y. If it does, and x x is a point of S which 
precedes y, there is at most a finite number of points of S less than, or 
equal to, Xi, and we denote the first of these by B x . If there are no 
elements of <S to the left of y, we put B\ equal to y itself. In either case, 
the point B\ is called the greatest lower bound of the set S. 

If there are elements of S which precede y, or if Bi is itself a member 
of S, then B\ is the least element of S. When y is not a member of S, 
and there are no elements of <S which precede y, the set has no least 
element. The greatest lower bound, B\, always has the property that 
there are no points of S to the left of B\, but any closed interval B\,c 
with Bi as its left-hand end point, contains at least one point of the set, 
say x. For, when Bi is the least element of the set, we may take B\ 
itself as the point x. If the set S has no least element, there are points 
of the set in B\,e since B\ is then a limit point of the set and there are no 
points of the set to the left of B\. 

The point B\ is thus the point with greatest coordinate having no 
points of S to its left. This explains the term greatest lower bound. 



REAL NUMBERS 


[Chap. I 



It will help the student to keep its meaning clear if he notes that lower 
is the important word in the phrase and that greatest is merely a modifier, 

We say that a point set S is bounded from below if there is some point 
on the line to the left of all points of the set. Any point not to the right 
of any point of the set is called a lower bound for the set. If a is any 
lower bound for the set S, and Xi is any element of S, we may form a new 
set S f by taking all those points x' which are in S and also have a sg x' g 
*i. As S' is on a finite interval, we may find a greatest lower bound B\ 
for it. This will be the greatest number not exceeding any number x', 
and hence the greatest number not exceeding any coordinate of a point 
of S . 

We may restate these results in terms of the coordinates of the points. 

A lower bound of a set of numbers is any number not exceeding any 
number of the set. 

A set of numbers is said to be bounded from below if it has a lower bound. 

A set of numbers which contains at least one number and is bounded from 
below has a greatest lower bound. 

We define upper bounds in a similar way and may obtain a similar 
result for them. Thus: 

An upper bound of a set of numbers is any number not exceeded by any 
number of the set. 

A set of numbers is said to be bounded from above if it has an upper 
bound. 

A set of numbers which contains at least one number and is bounded from 
above has a least upper bound. 

11. Heine-Borel Covering Theorem. We proceed to discuss a theo¬ 
rem on sets of intervals. Let / denote a set of intervals on a line. 
These intervals may be infinite in number and may overlap one another. 
It is immaterial for our purposes whether these intervals include their 
end points or not, but for definiteness we shall think of them as open 
intervals. 

Let C denote a particular closed interval a,b related to a set of inter¬ 
vals I in the following way: For each point x of C, that is, each x such 
that 

a ^ x | 5, (48) 

We may find some interval of the set I containing x as an interior point, 
say the interval 

y < x < y\ (49) 

We may use any interval of I for several, or even for an infinite number, 
of its interior points. Again, it may be possible to find several, or even 
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an infinite number, of intervals of I which will serve for a particular 
point x. We describe the relation of C to / by saying that the set of 
intervals I covers the fundamental interval C. 

The Heine-Borel covering theorem states that: 

If an infinite set of intervals I covers a fundamental closed interval C, 
then a finite number of intervals may be selected from the set I, such that 
this finite subset of intervals covers the fundamental closed interval C. 

To prove this theorem, we first define an accessible point of the inter¬ 
val C as a point of C, c, such that the closed interval a,c can be covered 
by a finite number of intervals selected from the set I. There are some 
accessible points, for a is in some interval of I so that any point of this 
interval to the right of a is accessible. If c is accessible, all points 
between a and c will also be accessible. 
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The set of accessible points is on a finite interval and therefore has a 
least upper bound, B 2 . Since b is an upper bound for all the points of C, 
it is an upper bound for the accessible points of C. Thus either B 2 < b 
or B 2 = b. 

Suppose we had the first case, B 2 < b. Then Bo, as a point of C, is in 
some interval of the set I, say 7i: 

Vi < x < y[. (50) 

From the properties of B 2 as a least upper bound of accessible points, 
there is at least one accessible point in I u say c u such that: 

Vi < ci & B 2 , (51) 

but any point c 2 such that 

B 2 < c 2 < y[, (52) 

is not accessible. 

But this is an impossible situation. For the finite set of intervals 
which cover the closed interval a,ci together with I\, covers the closed 
interval a,c 2 so that c 2 is accessible. This contradiction rules out the 
possibility B 2 < b. 

Thus B 2 = b, and since the argument used for c 2 shows that B 2 is 
itself accessible, we can cover the whole interval a, b with a finite num¬ 
ber of intervals of the set I, as stated in the theorem. 

We may modify the meaning of the term cover by omitting all parts 
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of intervals outside the fundamental interval and merely requiring a to 
be the left end and b to be the right end of some interval of /, in this 
case allowing some of the intervals of I to be closed. The proof pro¬ 
ceeds exactly as before. 

12. Closed Sets* The limit points of a set of points may, or may not 
be, points of the set. We define a closed set of points as a set of points 
which does contain all its limit points. Thus a closed interval is a 
simple example of a closed set. 

Since the greatest lower bound of any set of points is either the first 
point of the set or the first limit point of the set, the greatest lower 
bound of a closed set necessarily belongs to the set and is the first point 
of the set. Thus a closed set on a finite interval always has a first point and 
a last point . 

The theorem of the last section remains true if we replace the closed 
interval C by any closed set on a finite interval. If every point of a set S 
is an interior point of some interval of a set /, we say that the set of 
intervals I covers the set of points S. The modified theorem reads: 

If an infinite set of intervals I covers a fundamental closed set of points S 
lying in a finite interval, then a finite number of intervals may be selected 
from the set I, such that this finite subset of intervals covers the fundamental 
closed set of points S. 

Let a and b be the first and last points of the finite interval. If c is 
the mid-point of a, 6 , we may form two new closed sets S', the points of S 
in the closed interval a,c, and S", the points of S in the closed interval 
c,b. If the conclusion of the theorem held for each of these sets, it 
would hold for S, since the two finite subsets of intervals, taken together 
with common intervals counted once, would form a new subset covering 
S . Thus, if the theorem is false for S , it must be false for S' or S", or 
both. If both, take S'; otherwise, take the one for which it is false. 
Revise the notation, calling this set for which the theorem is false Si, 
and relabel the end points of the interval of length (h — a )/2 on which 
it lies a\ and b t . 


—A—.— ... 4 —IJL1—.— i__—.i— 

a c s b 

ai c r 

°2 c 2 0 % 

Fig. 3. 

Now repeat the argument, using cj, the mid-point of ox, b\, and so 
obtain a set S 2 on an interval 02,62 of length (6 — a)/ 4. Then con¬ 
tinue in this way. W© thus obtain a sequence of sets S n on an interval 
aa, 6 n of length (6 — a)/ 2 n , for each of which the theorem is false. 
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Since any finite number of points of S can be covered by a finite 
subset of intervals I, using a different interval for each point, each of the 
sets S n must contain an infinite number of points. Thus we may select 
a point Si in Si, s 2 a different point in S 2 , and so on. The set of points 
«i» ®a> > being infinite in number and all on the finite interval 

a,b, have at least one limit point. Since all the s n belong to S, and the 
set 8 is closed, this limit point belongs to S. Call it s. Then s is an 
interior point of some interval of the set I, say 7 0 : 

y < s < y\ (53) 

If the point s were outside of any of the intervals a n ,b n , an interval 
containing s and not containing the interval a m ,b m would not contain 
any of the s„ with subscripts larger than m. Thus s could not be a limit 
point of the s„. This proves that s is in every one of the intervals 
so that 

b n . (54) 


From this and the relation (53) we may prove that 

y < a n < b n < y f 


if n is sufficiently large. For since 


b n (in 



(55) 

(56) 


it may be made smaller than any fixed number by taking n large enough. 
Thus, in particular, for some value of n we shall have 

b n — dn < y f — s and b n — a n < s — y. (57) 


But, for this n the relation (54) holds, and it may be written: 

a n ^ s and — 6 n ^ —s. (58) 

It follows from the last two relations, (57) and (58), that: 

b n < y ' and -a„ < -y or y < a n . (59) 

Since b > a, equation (56) shows that b n > a n , which may be com¬ 
bined with the relations (59) to give the relation (55). 

But the relation (55) shows that the interval a n ,b n is covered by the 
interval I. Thus the set S n on this interval is covered by the single 
interval I, so that the assumed falsity of the theorem for S, which 
implied its falsity for S n , leads to a contradiction. 

Thus the theorem must be true for S, and we have proved the modified 
theorem. 
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IS. Two Dimensions, Definitions. We associate points in a plane 
with pairs of real numbers by the use of two rectangular axes, an as-axis 
and a y- axis. We take the point of intersection of these axes as the 
origin of a real number scale on each of the lines. Then any point in 
the plane has a projection on each axis, determined by a line through 
the point perpendicular to the axis considered or parallel to the other 
axis. If these projected points have coordinates x and y in their respec¬ 
tive scales, we speak of the point as having the coordinates (x,y), or 
briefly refer to it as the point (x,y). Each point determines such an 
ordered pair of real numbers, and conversely each such ordered pair 
determines a point in the plane, by our geometric assumption on the 
correspondence of numbers to points on a line. 

We refer to the points whose coordinates satisfy the inequalities 

a < x <b, c < y < d (60) 

as the points of the open two-dimensional interval a,b;c,d and frequently 
omit the phrase two-dimensional if it is implied by the context. 

If we wish to include the boundary points of such a rectangular 
region, we use the phrase closed two-dimensional interval a,b;c,d. Thus 
this means the points whose coordinates satisfy the relations 

a ^ x Sb, c ^ y ^ d. (61) 

Any collection of points in the plane is called a point set. A point 
(x,y) is a limit point of a set S if every open two-dimensional interval of 
the plane which includes (x,y) includes at least one point of S different 
from ( x,y ). As in the one-dimensional case, it follows that the open 
interval must include an infinite number of points of S. 

A set of points is said to be a closed set if its limit points all belong to 
the set. 

14. Two Dimensions, Theorems. We may extend the Bolzano- 
Weierstrass theorem to two dimensions. The new form of the theorem is: 

For every set of points lying in a finite two-dimensional interval and 
having infinitely many elements, at least one point of the interval is a limit 
point. 

To prove this, let the two-dimensional interval a,b ;c,d be one which 
contains the set 8. Divide this into four two-dimensional intervals by 
bisecting the two one-dimensional intervals a,b at e and c,d at /. The 
tour new intervals are-. a,e'J,d, e,b-,f,d, a,e;e,/, and e,b;cj. At least one 

cl these must contain an infinite number of points of S. If more than 

one contains an infinite number of points, we take that one which occurs 
, in the order listed above. Revise the notation so that the selected 
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infinite set of points is Si on R u the interval a u bi;c h di of dimensions 

(b ~~ a)/2 # (<* - c)f 2. 

Now treat Si as we did the original set, thus obtaining a set S& 
Continuing in this way, we shall obtain an infinite succession of sets 
S n on R n , the interval a nj b n ;c n ,d n of 
dimensions ( b ~ a)/2 n , (d — c)/2 n . 

Next consider the points with co¬ 
ordinates a n on the x-axis. If there f 
is an infinite number of distinct points 
in this set, the argument used in sec¬ 
tion 12 shows that there is a limit e 
point s which is contained in all the 
intervals a n ,6 n . If there is only a 
finite number of distinct points in this 
set, it follows from the method by which they were obtained that all the 
a n from a certain point on will have a common value. If we call this 
all the intervals a nj b n will contain s. 

Similarly we may find a point t on the y-axis which is either a limit 
point of the c n or equal to all of them from some point on. In either 
case it will be in all the intervals c n ,d n . 

The point ($ } t) is in all of the two-dimensional intervals R n . But 
the dimensions of R n are ( b — a)/2 n and ( d — c)/2 n and so may each be 
made less than any fixed number by taking n large enough. Conse¬ 
quently, any given open two-dimensional interval containing the point 
(s,t) will contain some one of the R n , and thus the corresponding set of 
points S n - As this includes an infinite number of points of S , at least 
one will be distinct from ($,() and the point (s,t) is a limit point of S . 
This proves the theorem. 

We may also extend the Heine-Borel covering theorem to two dimen¬ 
sions. In two dimensions, the phrase “ the set of intervals I covers the 
set of points S ” means that every point of S is an interior point of some 
two-dimensional interval of the set I. 

We need only consider the extension of the modified covering theorem 
of section 12, since that theorem includes the theorem of section 11 as a 
special case. The two-dimensional extension is as follows; 

If an infinite set of two-dimensional intervals I covers a fundamental 
closed set of points S lying in a finite two-dimensional interval then 
a finite number of intervals may be selected from the set I, such that this 
finite subset of internals covers the fundamental closed set of points $. 

To prove it, we select a two-dimensional interval a,b;c,d which con¬ 
tains the set S and divide it into four two-dimensional intervals by 
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bisecting the two one-dimensional intervals. Then, if the theorem 
were false for the set S, we could select a set from among these four for 
which it was false. With revised notation, this would be a set Si on 
J?i, the interval ai,bi;ci,di of dimensions (b — a)/ 2, (d — c)/2. 

By repeated bisection we should obtain a sequence of sets S n on R n , 
the interval a n ,b n ;c„,d„ of dimensions (6 — a)/2 n , (d — c)/2 n , for each 
of which the theorem was false. 

As each of these S„ contains an infinite number of points, we could 
select a sequence of points (x n ,y n ) from <S„, each point distinct from all 
those which precede it, as for the earlier proof in this section. The set of 
points ( x n ,y n ), as an infinite set of points on a finite interval, has a limit 
point (x,y), and this limit point belongs to S, since the set S is closed. 
Therefore it is an interior point of some interval 7 0 of I, since 7 covers S. 

But since all except a finite number of points ( x n ,y n ) are inside any 
interval R n , the limit point (x,y) must be in all the R„. Since the dimen¬ 
sions of R n , (b — a)/ 2 n and (d — c)/2" can be made less than any fixed 
positive quantity by taking n large enough, for some value of n the 
interval Iq will contain R n . Thus it will contain the corresponding set 
S n - Since the set S n is covered by this single interval, this contradicts 
the assumption that the theorem was false for S, from which we deduced 
that the theorem was false for S n - Thus the theorem must be true for 
S, and we have proved the two-dimensional covering theorem. 

16. Higher Dimensions. We may consider any number, k, of one¬ 
dimensional scales as axes belonging to x lt x 2 , ■ ■ ■ , x k . We continue to 
use geometric language, referring to X = (xi, x 2 , • • •, x k ) as a point in 
k dimensions, although we make no attempt to interpret our state¬ 
ments graphically when k is greater than 3. The definitions of section 13 
are easily extended to k dimensions. Thus the inequalities 


^ Xi ^ 1 “ 1, 2, 

■-,k 

(62) 

define an open fc-dimensional interval, and 

a,- g Xi £ b it i = 1, 2, • 

■ ■ , k 

(63) 


define a closed fc-dimensional interval. 

The definition of point set remains unchanged, and the definition of 
limit point and covering merely require us to read fc-dimensional for 
two-dimensional. There is no change in the definition of limit point. 

The theorems of section 14 remain true when we replace two-dimen¬ 
sional by ^dimensional, and the methods of proof given there require 
cntly minor modifications. 

Since the intervals we have used are bounded by (fe — l)-dimensional 
planes parallel to certain axes, our results seem to depend on the direc- 
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tion of the axes. However, we might use in place of a set of intervals I, 
a set of /D-dimensional spheres K given by 

T, 0. - c,) 2 ^ r 2 . (64) 

a«*l 

That the covering theorem still holds follows from the fact that any 
sphere K containing X as an interior point includes some interval I 
containing X as an interior point. Similarly, any interval containing X 
as an interior point includes some sphere containing X as an interior 
point. 

For any figure or point set in fc-dimensional space, we define an interior 
point P as one for which all the points of some fc-dimensional sphere 
with P as a center are points of the figure or set. An open h-dimensional 
region is a figure for which every point is an interior point. The cover¬ 
ing theorem remains true if we use fc-dimensional open regions of arbi¬ 
trary shape in place of the covering intervals. 


EXERCISES I 

1. Using mathematical induction, prove the binomial theorem (a + b) n = 
a n + na n ~ l b + • • • + n C r a n “ r // + • • * + b n , for integral values of n, where 

n(n — l)(r? — 2) • * • (n — r + 1) 


n C r 


1*2*3 


Prove that 


Z V(V + 1)(P + 2) * • • (p + m - 1) = 

p-1 


?i(n + l)(n 4* 2) * • • (n + m) 


m + 1 

3. From problem 2, and an induction on m, prove that if P(x) is a polynomial 
of the mth degree, the sum 

P( 1) + P( 2) + P(3) + • • • + P(») 

will be a polynomial in n of the (m + l)st degree. 

4. Prove the rule of cancellation for rational fractions 

ma __ a 
mb b 

5. Show that every positive rational fraction may be reduced to lowest terms 
or expressed as the quotient of two integers relatively prime, that is, without 
common factors other than unity. 

6. If a, 6, a', b\ and n are all positive integers, and ab' < a'6, prove that 

and ma ^ ^ — - are each a rational number intermediate in value 
mb + nb* (m + n)bb' 

between ~ and ~ • 
b b 
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% Prove that the adopted law of signs for negative quantities is the only one 
consistent with the properties of zero and the distributive law for products. 
Bird: Use the relations b — b « 0, a(b — b) *= 0, ab + a(— b) * 0, a(-~ b) — ab. 


8. Prove that, if a 9 * 0, no value of x is defined by ~ > interpreted to mean 


x * 0 * a; while if a * 0, any value of x satisfies the latter relation. This is 
why we do not define division by zero. 


9* Prove that, if b and V are both positive integers, — < — if, and only if, 

b b' 


db' < a'b. 


10. Prove that, if a < b and c< d, a + c < b + d and a — d < b — c. 

11. Prove that, for any two positive rational numbers a and b , an integer N 
can be found such that Na > b . 

12. If m and »take on all positive integral values, show that the set of values 
Omn is enumerable. 

IS. If a(»i, n 2 , • * * ,n*) depends on a finite number of variables, each of which 
takes on all positive integral values, show that the set of values assumed is 
enumerable. Hint: Use mathematical induction and the preceding problem. 

1C Assuming that no rational number has its square equal to 2, show that a 
cut with the properties PI, P2, and P3 of section 3 is defined by the following 
conditions: x is in class A if x < 0 or x 2 < 2, and x is in class B if x > 0 and also 
x 2 > 2. 

15. Verify that I, 1.4 are in class A and that 2, 1.5 are in class B for the cut 
defined in problem 14. 

16. If p and q are relatively prime, show that the fraction p 2 /q 2 is in its lowest 
terms as written. From this, show that no positive integer, not a perfect 
square, has a rational square root. Assume the theorem that every positive 
integer may be factored into prime factors in only one way. 

17. State and prove a result similar to that of problem 16 for the nth root of a 
positive integer. 

18. If the rational number x equals plq when reduced to lowest terms and 
satisfies the equation 


UnX n -f a«_ix n ~' 1 + • • • + aix + ao = 0, 


where the coefficients are all integers, and <z» and oq are both different from zero, 
prove that p is & divisor of ao and q is a divisor of a n . (Gauss.) 

19. Show that the equation 4x 3 — 12x 2 — x + 3 = 0 has three rational 
roots, then find the roots. Also show that the equation x 3 k -f 4x + 1 » 0 has no 
rational roots. Hint: Use the result of problem 18. 

20. If 0.9,0.99,0.999, • * * are all in class A, and 1.1,1.01,1.001, • • * are all in 
cl&ss B, show that the out must be that which is identified with the rational 
number 1. 

fQL If 0.3* 0.33,0.333, * • * are all in class A and 0.4,0.34, 0.334, • • • are all in 
class B, show that the cut must be that which is identified with the rational 
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22. For the cut which defines V2, find two rational numbers, a in class A and 
b in class B, which differ by not more than .01. 

23. For the cut which defines \/3, find two rational numbers, a in class A and 
b in class B, which differ by not more than 0.1. 

24. Using the identity 66' — aa! = a(6' — a!) + 6'(6 — a), show that, if we 
take b[ — a[ < c/2o lt where a x is any element of class A, and b x — a x < «/26j, 
we shall have 6 X 6( — a t a[ < €. This proves that the cut for yy f defined in 
section 5 satisfies the property P3'. Assume y and y positive, and take a x and 
a[ positive. 

25. Show that, if y > 0, and we take 6 — a < ta 2 , where a is any positive 
element in A, we shall have 1 ja — 1 /& < e. This proves that the cut for 1 jy 
defined in section 5 satisfies the property P3'. 

26. Prove from the definition that y • (1/y) = 1. 

27. Prove from the definition that y + (— y) = 0. 

28. If | y\ t the numerical value of y, is defined as y if y ^ 0 and -~y if y < 0, 
prove that \x + y\ \x\ + \y\. 

29. Let regular polygons of n sides be inscribed in and circumscribed to a 
circle of unit radius. Call /„ the perimeter of an inscribed polygon and C n that 
of a circumscribed polygon. Prove that, if we let the numbers I n be in class A, 
and the numbers C n be in class B, the properties PI, P2, and P3' are satisfied. 
The number defined by this cut is 2w. 

1 71 

30. Show that 0 and 1 are the limit points of the set - db-> and that 

2 2 n -f“ 1 

there are no others, where n takes on all positive integral values. 

31. Show that every number x such that 0 ^ x ^ 1 is a limit point of the set 
6 /2 W , where n is any positive integer and 6 is any odd positive integer less than 2 n . 

32. For any irrational number y let the fractional parts of the numbers ny, for 
all integral values of n, form a set. This set has every value of x, 0 ^ x jS 1 
as a limit point. HiTit: After N + 1 points have been plotted, some pair, say 
the fractional parts of Ti'y and n"y, will be at distance from one another less than 
1 /jV. Then the set of values k(n " — n , )y 1 for integral values of k , yield a set of 
fractional parts on the interval 0,1 some one of which is nearer than 1 /N to any 
point on this interval. 

33. Show that 0 is the greatest lower bound and 1 is the least upper bound for 
each of the three sets described in problems 30, 31, and 32. 

34. Show that the Heine-Borel theorem does not apply to the interval 0,1 if 
the intervals are 1 /n < x < 2/n, where n is a positive integer, but that the 
theorem becomes applicable if any one interval having zero as a left end point, 
e.g., 0 x < 1 IN for any value of N, is added to the set of intervals. 
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LIMITS OP FUNCTIONS 

We are now in a position to discuss the concept of functional depend¬ 
ence of one real variable on another. We shall develop certain results 
on the approach of a variable to a limit which are related to the notion 
of continuous function. We then proceed to study certain conse¬ 
quences of the property of continuity. 

16. Function. We say that y is a function of x and write y = / (x) if, 
for each of a certain set of values of x, there is determined one, or more 
than one, value of y. We refer to the values of x considered as the range 
of the variable X. If, for each x of the range, there is exactly one value 
of y, the function is single-valued. We call x the independent variable 
and y the dependent variable. In this chapter, the values of x and y 
will always be real numbers. 

17. Limits. We wish now to consider certain special ranges for the 
independent variable, t, and several other variables a, b, etc., each of 
which is functionally dependent on t. The range of t will always include 
an infinite number of values, which we may consider successively. 

These values, taken in order, may change abruptly. For example, 
the values of t may be: 1, 2, 3, • • • or 1, f, • • •. In such cases the 
values form a discrete sequence. Or t may take on in order all the 
points of an open interval — for example, increasing from 0 to 1 through 
all the intermediate values. Or t may increase from 0 through all 
positive real values, or decrease from 0 through all negative real values. 
In these cases the values of t form a continuous sequence. 

We write a t in place of a(t) to indicate that w r e are considering the 
single-valued variable a for a discrete or continuous sequence of values 
of t taken in order. We say that: 

The variable a t approaches a finite limit A if beyond a certain point in its 
succession of values the numerical value of the difference between a t and 
A becomes and stays smaller than any fixed positive quantity. 

We write in this case 

lim a t — A. (I) 

If we denote the numerical value of any real number c by |c|, so that 
|c| m e if c g£ 0 and |c| * — c if c < 0, the numerical value of the differ- 

24 
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ence which occurs in the definition is \A — a t \. We often use e to 
indicate a positive quantity which may be taken arbitrarily small. 
With this symbolism we may restate the definition: lim a t — A if for 
any positive e, 

|A — a t | < e, for t beyond t ( . (2) 

Here t, means some t in the succession of values, usually dependent on 
the « selected in the sense that the smaller e we select, the further out we 
must go in the sequence of t values. 

It follows at once from the definition that: 

if lim a t = A, lim ( A — a t ) = 0, (3) 

and conversely. 

Since the condition for approach to a limit only involves the values 
beyond a certain point in the values of t, which may be taken arbi¬ 
trarily far out, the values of t which precede any fixed t in the sequence, 
or the corresponding values of a t , have no effect on the limit. They may 
be arbitrarily changed, or even discarded, without affecting the limit. 
As an example, consider the discrete sequence of values of l, 1, 2, 3, • • • 
and the corresponding sequence of values of a t : 

1 1 1 
T 2 ' 2 2 ’ 3 2 ’ ” ’ ’ 

which approach the limit zero. We may derive f rom this such sequences as 

10, 20, 30, ~ 2 ’ -, 

obtained by adding terms at the beginning, 

1 1 1 


obtained by omitting terms at the beginning, 


or 


4, 8, 12, 42 » 52 > gjji 


obtained by changing terms at the beginning. 

Similarly in the continuous case, if t varies from 0 to 1, the limit of 
o ( = t 2 is 1, and this limit is unchanged if we consider t as varying from 
— 1 to 1, 0.9 to 1, or if we use any of these ranges with a t — 21? for l less 
than 0.99 and a t — t 2 for t greater than, or equal to, 0.99. 

If a t is a constant for all the values of t under consideration, a t — k, 
we may also write 


lim a t — k, 


(4) 
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dace all the conditions of the definition are satisfied. That is, a con¬ 
stant is a special case of a variable approaching a limit. Variable here 
means a quantity which may, but does not necessarily, change. 

18. Infinity. We say that: 

The variable a t becomes positively infinite if beyond a certain point in its 
succession of values the quantity a t becomes, and stays, greater than any 
fixed positive quantity. 

We write in this case 

lim a t = + oo. (5) 

If we indicate by N a positive quantity which may be taken arbi¬ 
trarily large, the definition in symbols is: lim a t = -f-® if for any 
positive N, 

a t > N, for t beyond <#. (6) 

Note that, whereas, for a finite limit, A — a t becomes small, the 
corresponding expression for an infinite limit has no meaning. Even 
if we regarded + 00 as a number subject to some of the arithmetic opera¬ 
tions, the value assigned to + °o — a t would be + «> which does not 
become small. Thus a t does not “ approach infinity as a limit,” but it 
is often convenient to read the relation (5) “ limit a t equals plus infin¬ 
ity,” instead of making the more precise statement “ a t becomes posi¬ 
tively infinite.” 

The definition of a variable becoming negatively infinite is similar to 
the above. In this case we write: 

lim at = — oo. (7) 

Or we may define this as being equivalent to lim (— a t ) = + «. 

19. Operations and Limits. If we perform any of the four funda¬ 
mental arithmetic operations on variables approaching finite limits, we 
usually obtain new variables approaching finite limits, where the limits 
are obtained by the same operations. More specifically, if 


lim a t — A and lim b t = B, 

(8) 

then it follows that: 

lim {at -f- bt) — A -f- B, 

(9) 

lim {at — b t ) — A — B, 

(10) 

(Vv lim a t b t = AB, 

(ID 

and, 

If B j* 0, lim ~ • 

bt & 

(12) 
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To prove these equations, we note first that: 

If at and fit ore too variables approaching zero and if p and q are each 
constants, or variables numerically less than some fixed quantity M, then 
pa t + qfit approaches zero. 

For, if we select any positive quantity e, a t and fi t will each differ from 
zero by less than e/(2 M) beyond a certain stage, and thereafter we shall 
have: 

I pat + qfi,\ £ \pa t \ + \qfi t \ < 2M*/(2M) = (13) 

To prove the four relations, we put: 

A - a t = a h B — h t — fit. (14) 

Then, if p ** 1, q = 1, we have: 

pat H~ qfit — A — at -f- B — bt = A -j- B — (at -f- bt). (15) 

Since this approaches zero, the relation (9) follows. 

If p = 1, q = — 1, we have: 

pa t + qfit = A - a t - (B — b t ) - A — B — (a t - b t ). (16) 

Since this approaches zero, the relation (10) follows. 

To prove the relation (11), we note that 

AB - a t b t = A(B -b t ) + b t (A - a,) = Afi t -\- b,a,. (17) 

But, for t beyond t f , |B — h«| < e < 1, so that |6 t | < |B| + 1. Thus, 
if we start with t' , we may take M as the larger of |A| and \B\ + 1 and 
deduce the relation (11) from the fact that the right, and hence the left, 
member of equation (17) approaches zero. 

To prove the relation (12), we note that 


A a t Abt — Bat 
1 b~ b t ~ Bb t 


£ (*-*>-!; d»-W 

I _Afl 

b t Bb t 


(18) 


But ultimately, say for t beyond t f , \B — h t | < e < |B|/2, and 
|f>t| > |B|/2. Consequently, if we start with t', we may take M as the 
greater of 2/\B\ and 2|A|/|B| 2 , and so show that the final member of 
equation (18) approaches zero, which proves the relation (12). 

Since, as remarked at the end of section 17, a constant is a special 
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case of a variable approaching a limit, we have as a special case of the 
relations just proved, 

lim (a t + k) = A + k, lim ( kat ) = kA , 

if k 9* 0, lim v = r ’ 

k k 

k k 

and if B 0, lim — = —• (19) 

bt B 


By repeated application of the fundamental operations of this section, 
we may treat the case of a polynomial in any number of variables, each 
of which approaches a limit. The polynomial will approach a limit 
whose value may be obtained by replacing each variable in the poly¬ 
nomial by its limit. A similar result holds for the quotient of two 
polynomials unless the limit of the denominator is zero. 

20. Determinate Operations on Variables Becoming Infinite. In 
certain cases where one of our variables becomes infinite and the other 
approaches a finite limit, the result of some of the operations on the vari¬ 
ables leads to a new variable whose behavior may be predicted. Thus 


if lim pt = 

+ oo, lim a t = A, 

(20) 

we have: 


lim — = 0, 

(21) 


Pt 

lim (p t + a t ) = + oo, lim (p, - a t ) = + oo, 

(22) 


lim (a, — p t ) = — oo. 

(23) 

Also, 

if A > 0, 

Pt 

lim a t pt — + oo and lim — = + oo. 

* n. 

(24) 


a t 


These results follow directly from the definitions. 

The correct behavior of the variable is obtained if we use the follow¬ 
ing operations with the symbols + «© and — °o in calculating the 
“limits”; 


-(+co) 


-00, -(-oo) 

1 


+ 00, (+ » ) + A 
0. 


+ *>, 


(25) 


And, 

if AL > 0, 


A • (+ 0O ) me + 00 . 


(26) 
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21. Indeterminate Operations. Such operations as 

(+»)—(+ 00 ) = ? or 4^- = ? (27) 

+ 00 

cannot be so simply treated, since, if lim p t = + 00 and lim q t = + », 
the variable p t — q t may not approach any limit, may become positively 
infinite, negatively infinite, or may approach a finite limit. For example, 
as n takes on the values 1,2,3, • • • , all the quantities in brackets become 
positively infinite, but [n 2 -f (— l) n n] — [n 2 ] takes on alternately increas¬ 
ingly large positive and negative values, [ n 2 + ( — 1)"] — In 2 ] is alter¬ 
nately 1 and — 1, while lim {[n 2 ] — [n]} = + «, lim {[n] — [n 2 ]} = — oo, 

and lim {[n + 3] — [«]} = 3. Thus each case must be examined sepa¬ 

rately. 

We note here that, 

if lim at = A > 0, lim b t = 0, and b t > 0, 

then lim ~^= +oo. (28) 

b t 

If b t does not have a fixed sign, the result may not follow, but 
if lim a t — A 0, lim bt = 0, and b t ^ 0, 

lim jr 1 ! = +®. (29) 

M 

Some writers use lim a t /b t = *> to indicate the last relation, and we 
shall find this notation convenient when dealing with complex quantities. 
When dealing with real numbers, we shall generally use oo as an alterna¬ 
tive to + 00 . Whenever the context leaves the meaning in doubt, we 
shall use the more explicit notation. 

As additional indeterminate operations, we have: 

^ = ? and 0- (+oo) - ?. (30) 

That is, the quotient of two variables each approaching zero, or the 
product of two variables one of which approaches zero and the other of 
which becomes infinite, cannot be predicted in advance for all cases. 

In arithmetic, the only undefined operation is division by zero. If we 
regarded + <*> and — oo as numbers, this would enable us to define the 
operations of the preceding section, but we should still have all the 
operations mentioned in this section as indeterminate among the unde¬ 
fined operations. Also, in many theorems we would have to except 
infinity. Therefore it is more convenient not to regard infinity as & 
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number and to regard it as being an exceptional situation when we can 
perform any of the arithmetic operations and so predict the behavior of 
combinations of variables becoming positively or negatively infinite. 

22. Inequalities and Limits. If a t is positive or zero for all values of t 
under consideration, its limit A cannot be negative. For, from 

a t ^ 0, A - —p < 0, or —A - p > 0, (31) 

we deduce 

at — A 2: p > 0, so that j A — a t \ 5 p, (32) 

and so cannot be made arbitrarily small. 

Thus A must be positive or zero, and we have: 

If a t 0 and Km a t — A, A ^ 0. (33) 

Even if a t is always positive, no stronger conclusion can be drawn, since 
the limit may still be zero. 

Next suppose that 

a t ■= b t , and lim a t = A, Km b t = B. (34) 

Thai we may deduce 
from — b t ^ 0, 

A — B ^ 0, hence A ^ B. (35) 

Here again, even if we have strict inequality for all values of t, we may 
have equaUty in the limit. Thus 

From inequalities in variables, we may deduce corresponding relations 
of inequality or equality for the limits. 

These remarks still apply if numerical values are involved, an 
inequality in numerical values being completely equivalent to two 
inequalities, i.e., 

|*| < b is equivalent to — b < x and x < b. (36) 

23. Upper and Lower Limits. Although we frequently make use of 
variables which approach Kmits, such variables are of a very special 
nature. We shall now study certain other ways in which a variable can 
act. 

If there is no positive number M such that the values of o t will ulti¬ 
mately be less than M, we say that a t has the upper limit plus infinity, 
and write 

Km a t = + «. (37) 

Suppose that there are numbers M, positive or negative, such that the 
values of o ( are ultimately all leas than M. Suppose further that not 
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every real number has this property of the numbers M. Then we may 
form a cut in the real number system by putting all numbers M into 
the class B and all other numbers into the class A. The number which 
effects the separation, L 2 , is called the upper limit of a t , and we write: 

lim o ( = Z/ 2 . (38) 

If every number has the property required of M, we say that a t has the 
upper limit minus infinity, and we write: 

lim a ( = — w. (39) 

Similarly to the above, by considering real numbers m such that the 
values of a t are ultimately all greater than to, we define the concept of 
lower limit, and the expressions: 

lim a t = — 00 , lim a t = L\, lim a t = + 00 . (40) 

Or, we may define 

lim a t = — lim(— a t ). (41) 

Any number M , which ultimately ex¬ 
ceeds every a t , is greater than any num¬ 
ber to, which ultimately is less than 
every a t . Consequently, when the 
upper and lower limits are finite, 

L\ Z/ 2 . (42) 

If the equality holds, 
and if L x = L 2 — A, lim a t — 

To prove this, we note that for any positive «, a t is ultimately less 
than L 2 + «, and ultimately greater than L\ — «, so that in the case 
under consideration we have, ultimately, 

A — « < a t < A + t, or \A — a,{ < e. (44) 

If a t has the upper limit minus infinity, every number, and in particu¬ 
lar every numerically large negative number, will ultimately exceed o t . 
It follows that 

if lim a t = — w, 

lim at - — * and lim a t — — ». 

Similarly, 
if Urn a t = + 00 , 

lim a ( — + ® and lim o t — + <». 


(45) 

(46) 
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By reversing these arguments, we may show that if a t approaches a 
finite limit, the upper limit and the lower limit are each equal to this 
limit. If a t becomes positively infinite, a t has the upper li mi t plus 
infinity and the lower limit plus infinity. If a t becomes negatively 
infinite, a t has the upper limit minus infinity, and the lower limit minus 
infinity. 

Whenever the upper limit is different from the lower limit, the variable 
a t cannot approach a limit, and it is said to oscillate. 

If a first result implies a second one, we say that the first result is a 
sufficient condition for the second. Since it is also true that we cannot 
have the first result without the second, the second result is a necessary 
condition for the first. When one result not only implies but is itself 
implied by a second, we say that the first implies the second, and con¬ 
versely. This form of expression is familiar to the reader from ele¬ 
mentary geometry, where the two results were usually of equal interest. 
We might also say that the first result is a necessary and sufficient con¬ 
dition for the second or that the second is a necessary and sufficient 
condition for the first. In this form of statement, we generally take 
the result less interesting in itself as the condition. In these terms, we 
may restate the main result of this section as a theorem: 

A necessary and sufficient condition for a variable to approach a finite 
limit is that the upper and lower limit of the variable be finite and equal to 
one another. 

It follows from the definition of upper limit and lower limit that, 
if 6( g c t , lim b t $ lim c*, and lim b t g Jim c t . (47) 

This fact may be combined with the theorem just stated to prove that: 

If a t jg bt g c t and if a t and c t approach the same limit L, then b t also 
approaches the limit L. 

It follows from the assumed inequalities that 


and 

lim a t | lim 6< | lim c t , 

(48) 

But, 

lim a t g lim b t g lim c t . 

(49) 

since lim a t — L, 

and 

lim a t = lim a t = L, 

(50) 

since lim c t = L, 

lim c t — lim c t = L. 

(51) 
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Thus we must have from the relations (48) and (49): 

lim b t - L and lim b t — L, so that lim b t = L. (52) 

This proves the result stated. 

24. Greatest and Least Limits. The upper and lower limits of a 
variable a t are sometimes called the greatest and least limits, for a reason 
which we shall proceed to study. Suppose that, from the continuous or 
discrete sequence of values of a t , we have picked out some infinite, 
discrete set of values, a„ where i = <j, t 2 , ■ • •, t n • • •, such that: 

lim i = lim t„ = lim /, • (53) 

a condition which will automatically be fulfilled if the values of t form a 
discrete sequence. Let us suppose further that the subsequence a,- is 
such that 

lim a, = A. (54) 

Then, since we can find values of i arbitrarily far out in the sequence 
i, and hence by the condition (53) we can also find values which are 
arbitrarily far out in the sequence t, for which 

a,- > A — e (55) 

where « is any positive number, it follows that any number M which 
ultimately exceeds the a t must satisfy 

M > A — «, or M S A, (56) 

since < is arbitrary. Since this is true for all M, it will also be true for 

the lower bound of the M, or L 2 , and so: 

L 2 £ A. (57) 

In a similar way we may show that 

L x ^ A. (58) 

Thus, when Li and L 2 are finite, for any limit A satisfying the rela¬ 
tions (53) and (54), we must have: 

Lx^A£L 2 . (59) 

Moreover, we may obtain each of the numbers L\ and L 2 as a limit 
by using a suitable sequence. We illustrate for L 2 . From the definition 
of L 2 , all the values of a t from a certain point in the sequence on are less 
than L 2 + 1/n, while some of them are in excess of L 2 — 1/n beyond 
any point. Hence, if we take a particular discrete sequence of values 
of t, tL such that 


lim t' n * lim t, 


(60) 
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we may successively find values of a< such that the nth value lies beyond 
the preceding value, beyond the value of t' n for the particular sequence 
satisfying the condition (60), and such that 

L 2 -< Oi < L 2 H—• (61) 

n n 

We shall then have 

lim i = lim t, and lim a,- «■ L 2 . (62) 

Thus we have found a sequence approaching L 2 . In the same way 
we could find a sequence approaching L x . 

This shows that, when L x and L 2 are both finite, there are sequences 
satisfying the relations (53) and (54) and that L\ and L 2 are among the 
values of A obtained. The inequality (59) shows that Li and L 2 are 
respectively the least and greatest of these limits. 

A similar argument shows that, if L 2 = + 00 , a sequence a,- can be 
found with lim o, = + », and likewise for the other infinite cases. 

When Li — — <», all sequences a,- are such that lim a,- = — *>, while 
if Li — + 00 , the relation A g L 2 is satisfied in the sense that any 
finite number is < + «. 

In this discussion, the number L 2 was ordinarily found by a cut and 
Was replaced by + <*> when the right-hand class was empty. Some of 
the operations with + oo, such as the inequality just mentioned and 
those defined in section 20 are consistent with the interpretation of + <» 
as corresponding to a cut with the right-hand class empty. 

26. Sequence Definition of Limit. The fact that L\ and L% are the 
greatest and least limits obtained from discrete sequences, combined 
with the condition for approach to a limit which we obtained in section 
23, leads to another interpretation of a variable approaching a finite 
limit. For, if every discrete sequence o, such that lim t «= lim i ap¬ 
proaches the same limit L, the greatest and least such limits L t and L 2 
must each equal L, and the variable approaches the limit L. Con¬ 
versely, when a variable approaches a limit L, since the greatest and 
least limits obtained from such a sequence a,- each equal L, the same is 
true of every discrete sequence obtained from it with lim i «* lim t. 
Hence every such sequence approaches the same limit L. This leads to 
an alternative definition of approach to a limit, in terms of limit of a 
discrete sequence: 

The variable a t approaches a finite limit A, if for every discrete set of 
vakm ofl,im tn, such that lim i =* lim t, we have lim a,- = A. 

A similar statement reduces the definitions of lim a, =» -}-», lim a< •» 
— oc to the corresponding situations for discrete sequences. 
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For a discrete sequence, we may define 

The variable a n approaches a finite limit A, if there are at most a finite 
number of values of n for which 

\A-a n \> e, (63) 

far any arbitrary positive number t. 

A similar definition may be made of lim a n = + 00 , where the inequal¬ 
ity satisfied by at most a finite number of values is a„ < M, for any 
positive number M. We may also frame a definition of this type for 
lim a n = — oo. 

These definitions are taken as fundamental by some writers, who 
dislike the reference to time in the other definitions. It is useful for the 
student to appreciate both definitions of limit, as some arguments seem 
clearer with one and some with the other point of view. 

26. The Cauchy Convergence Criterion. By using the upper and 
lower limits we may establish a second condition for a variable to 
approach a finite limit, known as the Cauchy convergence criterion. 
The theorem is: 

A necessary and sufficient condition for a variable a t to approach a finite 
limit is that for any positive quantity »j, there is some point in the sequence 
of values of i, t„ such that the difference of any two values of a t , each with t 
beyond f,, is numerically less than ij. 

In symbols, the condition is that for any positive ij, 

|a u — a„| < n, if u,v follow t, in the sequence. (64) 

To show that the condition is necessary, we assume that a t approaches 
a finite limit A. Then 

| A — Oj| < ^ > if t follows I® in the sequence, (65) 

A 

from the definition of a limit, where to is <« for t = tj/2. 

In consequence of this, if u and v are any two values which follow to, 
we may write: 

|A — o„| < and \A - o„| < (66) 

Hence 

|q* —* o,,) |(®u -- A) (o» A )| < i). (67) 

Thus we may satisfy the condition of the theorem by taking t, = fo. 
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To show that the condition is sufficient, we start by assuming that 
the relation (64) holds. We keep *j and u fixed and let v take on any 
value beyond u. Then, for any such v, 

|a« — «®| < v, or o„ — ri < a v < a u + jj. (68) 

Thus, in the sense of section 23, a u — y is a possible value of m and 
a u i? is a possible value of M. Consequently, the upper and lower 
limi ts of at are both finite, and 

a u — t) :g L\ L 2 £s a u + y. (69) 

From this it follows that 

0|L 2 -L^ 2tj, (70) 

and, since y is arbitrary, we must have L t = L 2 , and a limit is therefore 
approached. 

27. Monotonic Variables. A variable a t is increasing if each value is 
greater than any preceding value. If each value is merely greater than, 
or equal to, any preceding value, the variable is said to be monotonically 
increasing or never-decreasing. The behavior of a monotonically 
increasing variable is of a simpler nature than that of the unrestricted 
variable discussed in section 23. We shall show that: 

A never-decreasing variable, and in particular an increasing variable, 
either approaches a finite limit or becomes positively infinite, according as 
its values have, or have not, a finite upper bound. 

If the values of the variable a t have no finite upper bound, any fixed 
positive number N will ultimately be exceeded by some a t . But, since 
the a t never decrease, all the a t beyond this point will also exceed N. 
Hence, in this case we have 

lim a t = +•*>. (71) 

If the values of the variable a t admit a finite upper bound M, a t will 
have a finite upper limit L 2 . Hence, for any positive number t, we have 

a t < L 2 + «, for all t beyond a certain t', (72) 

and 

a t > L 2 — e, for some t" beyond this t', (73) 

since both of these relations are consequences of the definition of an 
upper limit. 

But, since the a ( never decrease, 

a t > L 2 — e, for all t beyond t" 


(74) 
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so that, in view of the relation (72), 

|La — a, | < t, for all f beyond t". (75) 

As « was arbitrary, we may take t" as the t, in the original definition 
of a limit and conclude that a t approaches the limit L 2 . 

In a similar manner, or by considering — a,, we may define what is 
meant by a monotonically decreasing, or never-increasing, variable, 
and prove that: 

A never-increasing variable, and in particular a decreasing variable, 
either approaches a finite limit or becomes negatively infinite, according as 
its values have, or have not, a finite lower bound. 

28. Nested Intervals. Frequently we locate a point with desired 
properties by using a sequence of intervals, each of which is contained 
in the preceding. We made use of this process in section 12. Condi¬ 
tions under which this process leads to a unique point are given by the 
following theorem: 

If a discrete, infinite sequence of closed intervals a n ,b n is such that each 
includes the following, and the length of the nth interval approaches zero as 
we go out in the sequence, there is one, and only one, point which is a point 
of every one of the closed intervals. 

Since the nth interval includes the (n + l)st, we have 

a n g a n+1 < bn+i g b n . (76) 

Thus the left-hand end points, a„, form a monotonically increasing 
sequence, with an upper bound b u and so approach a limit A. Simi¬ 
larly the right-hand end points, b n , form a monotonically decreasing 
sequence, with a lower bound ai, and so approach a limit B. Also, 
from repeated application of the inequality (76), we find: 

On =5 On+m ^ ^ b n . (77) 

If we keep n fixed in this and let m increase, we may deduce from it that 

a n ^A^B^b n , (78) 

and hence 

0 g B — A ^ 5n — On- (79) 

But, since the limit of the right member is zero, this shows that 
B — A 0, or B ** A. This gives a point which is in all of the inter¬ 
vals because of the inequality (78). 

That this is the only point in all of the intervals may be shown by 
assuming that C is in all the intervals. Then: 

On S ^ 


(80) 
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and from this, on taking the limits, 

4 I C | B, or C = A, since B = A. (81) 

If we take one point from each of the intervals, c„, these points will 
approach the point A as a limit. For, since 

a n ^ Cn ^ &„> and B = 4, (82) 

it follows that lim c„ = A, by the last theorem of section 23. 

29. Functions on Closed Intervals. The definition of a function 
already given — y is a function of x on a range if, for every value of x 
in the range, one or more values of y are determined — puts little 
restriction on the values of x or y. Thus, if y = 1 or — 1 when x = 0 
and if y equals any real number whatever when x — 1, we have a func¬ 
tion defined for the range consisting of the two values 0 and 1. It is 
two-valued at 0 and infinitely many-valued at 1. 

Let us restrict our attention to functions defined for all the values of x 
in some closed interval, a ^ x iS b, and single-valued for these values 
of x. The requirement that the function be single-valued is not al¬ 
ways a natural one from the standpoint of geometric applications, but 
may usually be met by suitable conventions. Thus, the equation 
x 2 + y 2 == 1 must be thought of as defining two single-valued functions 
in the interval —1,1, namely, 

y = +VT — x 2 and y — — Vl — x 2 . (83) 

As an additional example of a single-valued function on an interval, 
we may put 

y = 1 for x rational and 0 g x g 1, 
y = 0 for x irrational and 0 < x < 1. (84) 

A simpler example is given by 

y = x, 0 ^ x jS and y — 1 — x, | ^ x 1. (85) 

Again, y = x 2 defines y as a function of x. This last function — 
like the two defined by equation (83) and the one defined by (85), and, 
in fact, like most of the functions met in elementary mathematics — 
have graphs which can be drawn without lifting our pencil from the 
paper. We proceed to give a more precise definition of this property. 

30. Continuity. If y — /(x) is a single-valued function of x defined 
for all x in the closed interval a,b, i.e., a ^ x ^ b, and x 0 is a value of x 
in this interval, hy 

lim f(x) = A, 


( 86 ) 
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we mean that, for any positive e, there exists a second positive quantity 
8„ such that 

|A — f(x)\ < e for all x ^ x 0 , such that \x — x 0 \ < S e . (87) 

We read x —► x 0 as “ x tends to x 0 ,” or “ x ap¬ 
proaches £o," and shall sometimes use the notation 
x — * x 0 by itself. 

If we wish to consider only values of x greater 
than xq, we write 

lim f(x) = A, (88) 

x—►x 0 -h 

to mean that, for any positive «, there exists a 
second positive quantity 8„ such that 

|A — /(x)| < e for all x > x 0 , such that x — x 0 < 8 t . (89) 

This is a limit on the right. 

Similarly we may denote a limit on the left by 

lim fix ) == A, (90) 

X—►Xo- 

meaning that, for any positive e, there exists a second positive quantity 
8„ such that 

| A — f{x) | < « for all x < x 0) such that x 0 — x < 5,. (91) 

If the function approaches a limit A at x 0 in the sense of equation (86), 
both the right-hand limit given by equation (88) and the left-hand limit 
given by equation (90) exist and equal A. Conversely, if both these 
last limits exist and are equal, the limit exists in the first sense. 

The limit on the right is analogous to our earlier definition for a 
continuous sequence, x here decreasing from b to x 0 , the range being 
open at the left as the number x 0 itself is excluded. This suggests that 
we define 

lim fix) = + oo (92) 

to mean that, for any positive N, there exists a second positive quantity 
8ff, such that 

fix) > N, for all x > x 0 , such that x — x 0 < 8^. (93) 

The definitions of 

lim fix) = +» and lim fix) = + « 

X—►Xo — *—+30 

are quite similar, and we do not bother to state them explicitly. 
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The corresponding relations for — » are also defined in an entirely 
similar manner. 

The Cauchy convergence criterion for a function approaching a limit 
may be formulated as follows: 

A necessary and sufficient condition for the existence of a finite limit for 
f(x) as x —* Xq is that, for any positive number «, there exists a correspond¬ 
ing positive number S t such that \f(x') — f{x")\ < t, for any two values of 
x distinct from x 0 and such that |x' — x 0 | g 8, and \x" — xq\ g 5,. 

The necessity of the condition, where x' and x" are on either the 
same or opposite sides of xq, is proved exactly as in section 26. For the 
sufficiency, we note that, if the condition holds for x and x" when both 
are to the right of Xo, the limit on the right exists by the theorem of 
section 26. Call this limit B. Similarly the limit on the left exists by 
the same theorem. Call it A. Then, since |/(x / ) — f{x")\ < t, for 
all x' and x" such that 

\x f — x 0 | < 8, and \x" — xq\ < 8„ (95) 

we may take x’ on the left and x" on the right and let them each approach 
Xo. We thus deduce that 

|A — B\ g €, and hence B = A, (96) 

since t is arbitrary. Thus the limit exists, as the right- and left-hand 
limits exist and are equal. 

We may now define continuity in terms of the notion of limit of a 
function. A function, defined as having a finite value, /(x 0 ), for a value 
xo. is said to be continuous at the point x 0 if 

lim/(x) =/(x 0 ). (97) 

A function, defined and finite at each point of the closed interval 
a £ x Ja b is continuous throughout the closed interval a,b if the relation 
(97) holds at all interior points of the interval and at the end points: 

lim f(x) - /(a), lim /(x) = f(b). (98) 

w— w»4* x—— 

Using the conveyance criterion just established, and the definition of 
continuity just given, we may show that: 

A necessary and sufficient condition for f(x) to be continuous at the 
point Xq is that, for any positive number t, there exists a corresponding 
positive number 6, such that \f(x') — f(x")\ < t, for any two values of x 
such that |x' — xo\ & and \x" — ®o| & 8,. 
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In this condition we have not excluded x 0 itself as a possible value of 
x' and x". In this respect the situation differs from our previous 
definitions and results concerning limits, which were all independent of 
the value at the place approached. 

31. Bounded Functions, Oscillations. Let the function y = fix) be 
defined on the interval a,b which may be open or closed. The function 
is said to be bounded on this interval, if the corresponding values of 
/ (x) all lie on some finite interval c 2£ y ^ d. By the theorems of section 
10, these values of y have a least upper bound M and a greatest lower 
bound m. The difference M — to is called the oscillation of the func¬ 
tion in the interval. 

If, for any fixed number c, there are values of x in the interval a,b 
for which/(x) < c, the function has no lower bound. We indicate this 
by writing m = — <». Similarly, if for any fixed number d, there are 
values of x in the interval a,b for which /(x) > d, the function has no 
upper bound. In this case we write M — + <». In either of these 
cases the function is said to be unbounded, and we say that the oscillar 
tion of the function is infinite. This is natural since, for m = — », 
M finite; m finite, M — + °°; or m — — ao, M = +<x> t M — m is an 
operation of the type described in section 20, and M — m = + ». 

Let x' and x" be any two points of the interval a,b. Then 

m g fix') :£ M and m f(x") ^ M. (99) 

From this it follows that: 

|/(x')-/(*")I SM-m. (100) 

Again, suppose that for all pairs of points % and x" in the interval 
a,b we have 

I fix') - /(*")! S k. (101) 

Then 

f(x") -k£ f(x ') ^ fix”) + k. (102) 

Thus, if we keep x” fixed and vary x', we see that/(x) is bounded on the 
interval and so has both bounds, M and m, finite. But, as M is a least 
upper bound, for any positive«, there is some x' in the interval for which 

fix') > M — e. (103) 

Similarly, since mis a greatest lower bound, for some x”, 

fix”) <m + t. (104) 

It follows that 

M — m — 2e < fix') - fix”) £ k, (105) 
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and, since e is arbitrary, 

M — m £ k. (106) 

The inequalities (100) and (106) show that a restriction on the size of 
\f(x') — fix") | leads to a restriction on the oscillation and conversely. 
Consequently, we may formulate as an alternative to the condition for 
continuity given at the end of the last section: 

A necessary and sufficient condition for f(x) to be continuous at x 0 is that, 
for any positive number «, there exists a corresponding positive number 5, 
such that the oscillation of fix) in the interval \x — x 0 | £ 8, is less than e. 

32. Uniform Continuity. Let fix) be continuous at all points of an 
open interval. Then, for each point z 0 of the interval and any positive 
«, we may find a 5 such that the oscillation of the function in the interval 
|x — Xo| < 5 18 less than e, in accordance with the theorem just proved. 
The possible values of S will usually depend on e and x 0 . We may indi¬ 
cate this by writing 8(e,x 0 ). This is an infinitely many-valued function 
of the two variables, since if we have any value, any smaller positive 
number will also serve. It may not be possible to find any value of 8 
which will serve for a given e for all x 0 of the open interval. Thus, if 
f(x) = 1/x and the interval is 0 < x < 1, the function is continuous at 
all points of the interval. However, the oscillation of f(x) for the 
interval 0 < x < Xo is infinite. Hence for any e, the value of 8(e,x 0 ) 
cannot be as large as x 0 . Thus for a particular e, no one value of 8 will 
serve for all x. For, no matter what <?i we attempt to use, there are 
values of xq in the interval 0 < x < 1 with x 0 < 8 X . 

On the other hand, if fix) = 2x, 0 < x < 1, we may take any value 
less than e/4 as a S(e,x 0 ) for all x 0 in the interval 0,1. If, as in this case, 
a value of 8 may be found for any e which does not depend on x 0 , the 
continuity is said to be uniform with respect to x for the range under 
consideration. 

If f(x) is continuous at all points of the closed interval a,b the rela¬ 
tions (98) hold at the end points. It is easy to deduce from these one¬ 
sided relations results similar to those of sections 30 and 31. In particu¬ 
lar, for any e there exists a 8, such that the oscillation of f(x) in the 
interval a £ x £ a + 8 t is less than e. Similarly, there exists a 8, 
such that the oscillation of fix) in the interval b — 8, £ x £b is less 
thane. 

We shall now prove that: 

A function, y * fix), continuous at all points of the closed interval 
a £ x £ b, is uniformly continuous in that interval. 
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By the theorem of section 31, for any positive number ij, each interior 
point of the interval a ^ x g b is in some closed interval x 0 — 5 0 £ x £ 
x 0 + 5o> in which the oscillation is less than ij. And, as just pointed 
out, the ends a and b are end points of intervals in which the oscillation 
is less than y. Hence, by the form of the Heine-Borel covering theorem 
mentioned in the remark at the end of section 12, a finite number of 
intervals can be selected from these which cover the closed interval a,b. 
Let all the end points p,- of these covering intervals be marked, and con¬ 
sider all the distances between two distinct end points, corresponding to 
the same or different intervals. As these distances are finite in number, 
there is a least such distance, say 5 m . Now consider any interval 7 of 
width less than S m , consisting entirely of points of the closed interval 
a,b. Such an interval can include at most one end point of the covering 


intervals, say pi. Then, if x r and x n are any two points of /, since x f 
and pi are in the same covering interval, 

W) ~f(Pi)\ < v, 

(107) 

and similarly 

I/(pi) -/(*")! <* 

Thus 

!/(*') -/(*")| <2,, 

(108) 

(109) 

and, by the inequality (106), 


M — m g 2 rj. 

(110) 

Thus for any given positive quantity €, we may take 
by the above process find a S m , and hence a 5 0 , 0 < 6 0 < 
the oscillation of f(x) in any interval of length at most 8 0 
In particular, we may use this 5 0 as a $(€,£o) f° r x o 

v < «/2, and 
5 m , such that 
is less than t. 
of the closed 


interval a,b. This establishes the uniform continuity. 

33. Maximum and Minimum of a Continuous Function. A function 
continuous at all points of an open interval need not be bounded, as the 
example y = 1/x, 0 < x < 1, discussed in the preceding section, shows. 
However, 

A function , continuous at all points of a closed interval, is bounded on 
that interval. 

We prove this by noting that, since the function is uniformly con¬ 
tinuous we may find a 5 such that the oscillation of /(x) in any interval 
of width less than 5 is less than t. We take e = 1 and select N so large 
that 1/N < S. We then divide the interval a,b into N equal parts, by 
points 


a = p 0 < pi < • • • < pn-i < Pn - b. 


(Ill) 
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Then, from the choice of 8 and N, we have 

l/(p*+i) ~f(Pi)\ < 1, (112) 

and for any x and the greatest p, less than x, we have: 

\m - /(?,■) i < i. (H3) 

It follows from the relations (112) and (113) that: 

|/(x) — /(a) | < N, (114) 

or 

f(a)-N <f(x) <f(a)+N, (115) 

for all x in the closed interval. Thus the function is bounded in that 
interval. 

A bounded function on an interval always has a least upper bound M 
and a greatest lower bound to, as shown in section 31. However, for a 
discontinuous function, there may not be any values of x in a closed inter¬ 
val where these bounds are taken on. Thus, if f(x) is 1 at 0 and 1, 
and 2x for 0 < x < 1, the function is defined for the closed interval 
0 2s * a£ 1. For this interval M = 2 and to = 0, but these values do 
not correspond to any values of x in the closed interval. 

The same situation may arise for a function which is continuous in an 
open interval, as the example f(x) = 2x for 0 < x < 1 shows, since the 
values (AM - 2and to = 0 do not correspond to any values of x in the 
open interval. 

However, for a function which is continuous on a closed interval, the 
case is different. In fact, since the least upper bound of a function on 
an interval, M, is the least upper bound of the values of f(x), by section 
10, it is either one of these values or a limit point of these values. In the 
first case, there is a value xo such that 

/(xo) - M, (116) 

and the upper bound is taken on. 

In the second case, we can find an infinite discrete sequence of points 
Xi such that 

lim /fa) - M. (117) 

Since the points Xi axe infinite in number and on a finite interval, they 
have at least one limit point xo. Let xj be any subset of the x< — 
renumbered if necessary — approaching zq as a limit as j increases. 
Tbea 

lim X/ * x 0 and lim/(x,-) = M. (118) 
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So far, the argument has not made any reference either to the con¬ 
tinuity of the function or to the fact that the interval was closed. In 
fact, in both examples of bounded functions given above, we can find a 
set of values approaching a limit value (any set of values approaching 1) 
so that the limit of the values of fix) on these values is M (here 2). 

However, let us return to the case of a function continuous on a closed 
interval. Since the interval is closed and all the Xj belong to it, so 
does the limiting value x Q . Again, since the function is continuous at xo, 

lim /(x)=/(x 0 ), (119) 

or the corresponding one-sided relation if x 0 is an end point. 

From the relations (118) and (119), we have 


/(* o) = M, (120) 

and the least upper bound is taken on. 

When the least upper bound is taken on, it is a value of the function 
greater than, or equal to, all other values, and is called a maximum. 
Similarly, when the greatest lower bound is taken on, it is called a 
minimum. By reasoning as above, or by considering the function 
— f(x), we may deduce results for lower bounds similar to those just 
proved for upper bounds. This leads to the theorem: 

A function, continuous at all points of a closed interval, takes on its 
maximum value at least once at some point of the interval and also takes on 
its minimum value at least once at some point of the interval. 

34. Intermediate Values. If a function is continuous throughout 
the closed interval a,b and is positive at one end, say /(a) > 0, and nega¬ 
tive at the other end of the interval, f(b) <0, then we must have 
f{x) = 0 at some point x of the open interval a,b. For, consider the 
points x' such that 

fix) > 0, a ^ x £ x', (121) 

and denote their least upper bound by xo. Then every interval I,-, 
including xo as an interior point has a point x» to the left of Xo, for which 
fix) > 0. Hence for a sequence of /, with lengths decreasing to aero, 

/(xo) - lim/(x.) S 0. (122) 

But every interval /,• also has a point x,- such that Xj s£ xo, for which 
fix) 2 ? 0. Hence 


f{xo) = lim f(x } ) 0. 


(123) 
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It follows from the relations (122) and (123) that 

/<*o) = 0, (124) 

which proves our contention. 

We may readily extend this to a general intermediate value property: 

A function, continuous at all points of a closed interval, a sg x £b, 
takes on every value between f(a) and f(b) at some point of the interval 
between a and b. 

If, for example, A is an intermediate value and /(a) is less than f(b), 
so that: 

/(«) <h </(&), (125) 

the function 

F(x ) - h — f(x) (126) 

is positive at a and negative at b, so that at some point x 0 between a and 
b it is zero. Thus 

0 = F(x q) = h - /(x 0 ), and f{x 0 ) - h, (127) 

as we set out to prove. 

The intermediate value may be taken on several times, or even an 
infinite number of times. The method of proof shows that there is a 
smallest value of x<> on the interval. A similar argument would show 
that there is a greatest value of x 0 on the interval. 

35. Functions of Several Variables. Many of the definitions and 
theorems of this chapter may be extended to functions of more than one 
variable. If we have k variables and use the geometric language of 
section 15, our set of k independent variables may be referred to as a 
point in k dimensions, X = (xj, x 2 , • • •, x*). 

Thus, we say that y is a single-valued function of k variables and 
write y — f(x\, x 2 , • ■ •, x*) if there is one value of y associated with 
each X, or set of values of the x,- in the range under consideration. When 
the number of variables is implied by the context, we write y = /(x,) or 
V - f(X). 

Let the function be defined in a ^-dimensional interval including A = 
(«h, 02 , • • •, a*) as an interior point. Let X n = (x„i, x„ 2 , * • •, x„*) 
be a discrete sequence of points such that: 

lim Xni - Oi, lim x n2 = a 2 , • • • , lim a nk = a*. (128) 

We briefly describe this situation by saying that the points X„ ap¬ 
proach the point A as a limit, and we write 


lim A. 


(12Q) 
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as an abbreviation for the relations (128). Then, from some n on, all 
the points X n will be in the interval in which the function is defined. 

The function y = /(X) is continuous at A, if lim f(X n ) = f(A) for 
every discrete sequence X n such that X n —> A. 

This definition is analogous to that given in section 25. 

An equivalent definition is: 

The function y = /(X) is continuous at A if for every positive number e 
there is a corresponding positive number such that 

I f(A) ~/(X)| < €, if \ x% - 0,1 < «„ i = 1, 2, • • •, fc. (130) 

To see the equivalence, we note that, if the second definition holds, for 
any sequence X n such that X n —•> A, from some n on, we shall have 
| x n i ~ a,| < 6 e , for all the i, so that for this sequence | f(A) — f(X )J < e 
from a certain point on. Hence lim /(X n ) = /(A). 

On the other hand, suppose the second definition failed to hold for a 
limit A . Then for some €, we should have ) f(A) — /(X)| ^ €, for some 
X with \x % — a x \ < l/n , for all values of n. Let Xi be one such point 
for n = 1, and take % such that l/n 2 is less than the largest value of 
\x u — a,|. Let X 2 be one point for n 2 for which | f(A) —/(X)j ^ c, 
and repeat the process successively to form a sequence Xi, X 2 , 

Then, we have 

lim X n - A, and \f(A) - /(X n )j ^ 6, (131) 

so that we cannot have lim f(X n ) = f(A) . Thus the first definition also 
fails to hold for this A. 

Since the first definition cannot apply when the second one fails to 
apply, if the first definition applies, the second does also. Thus each 
definition implies the other, and the two are equivalent. 

The two definitions apply as they stand to interior points A of any 
open region of definition of the function. If the region of definition of 
the function includes boundary points B , which are at the same time 
limit points of sequences of points of the region, and also of some 
sequences of points not belonging to the region, the definitions do not 
directly apply to such points. In considering such boundary points, 
we modify the definition by considering only points A r n or X which 
either belong to the interior of the region or are boundary points. 

If we consider the 8 ( of the second definition for different points A , it 
will presumably be necessary to select different 8 for different points A, 
and, for some regions of definition, it may not be possible to find any 8 
which will serve for a given € for all the points of the region. 

However, for a closed region, that is, one which includes all its limit 
points, and hence all the boundary points, we may prove that a 8 may be 
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Sheeted independent of A. The proof is similar to that for one dimen¬ 
sion, where the ^-dimensional Heine-Borel theorem is used in place of 
that for one dimension. That is; 

A function of k variables, continuous in a closed k-dimensional region, 
is uniformly continuous in that region. 

From this we may deduce that such a function is bounded and takes on 
its maximum and minimum values in the region. 

There is no simple extension of the intermediate value property to 
more than one dimension. 

It follows from either definition of continuity that a function of 
k = m + n variables, continuous in all the k variables as a set, becomes 
a continuous function of the n remaining variables if m of the variables 
are kept fixed. In particular, if all except one of the variables are kept 
fixed, the function is a continuous function of the remaining variable. 
Thus, 

A continuous function of k variables is continuous in each of the vari¬ 
ables, considered one at a time. 

The converse of this is not true. Thus f(x,y) = 2xy/(x + y), for 
(x,y) A (0,0) and /(0,0) = 0, is continuous in x for each value of y 
and continuous in y for each value of x, but, since the function equals 1 
forx = y, we may find points arbitrarily close to (0,0) for which/(x,y) — 
/(0,0) ■= 1, and so the function is not continuous in the two variables 
at (0,0). 

A second interesting example is f(x,y) — 2xy 2 / (x 2 + y A ), for (x,y) A 
(0,0) and/(0,0) = 0. This function is zero on the x-axis and also on the 
y-axis, and on any oblique straight line through the origin, y - mx, 
f{x,y) =* 2 m 2 x/ (1 + m*x 2 ). Thus the function approaches zero as we 
approach the origin on any straight line through it. However, the func¬ 
tion is not continuous at (0,0), as we see by approaching the origin along 
the parabola x = y 2 , for which f(x,y) - 1 . This illustrates the diffi¬ 
culty of using the definition of continuity in terms of sequences as a test, 
since We must examine all possible sequences. 

36. Composite Functions. Let y =* /(x) be a single-valued function 
of x, continuous at x *= a, and let /(a) « b. Again, let u — g(y) be a 
single-valued function of y, continuous at y - b. Then we have: 

lim g[f(x)] * limg(p) * g(b) = g\f(a)]. (132) 

Thus u(x) - g{f(x)] (133) 

Is continuous at a. That is, 

' A continuous function of a continuous function is continuous. 
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This remains true, regardless of the number of variables. That is, if 
Vi * /<(*u * 2 , • • •, x m ) is continuous at x i = a h j = 1, 2, • • •, m; for 
i m 1, 2, • • •, n and/,(«,-) = 6,-; while u = 0 ( 2 / 1 , j/ 2 , • • •, 2 /») is continu¬ 
ous at yt «= bi‘, then u is a continuous function of the m variables Xj 
at Xj =* a,j. 

37. Inverse Functions. Consider the equation y - f(x), where fix) 
is a single-valued continuous function of x and, for some interval 
a ^ x ^ 6, is increasing with x. That is, for any two values of x in the 


interval, x\ and x 2 , 

f{x 2 ) > fix i) if x 2 >xi. (134) 

Then, in the interval on the y- axis, 

f(a)£y£f(b), (135) 

the relation between x and y defines x as a function of y, 

x=rHv), (136) 

which is also single-valued, continuous, and increasing. 

We first note that if yi is any value satisfying the relation (135), by 
the intermediate value property of section 34, there is some xi such that 

= /(xj) and a g xi ^ b. (137) 

There cannot be two such values, since y increases with x. We put 
xj = r'iVi), thus defining the function This function is 

increasing, since by the relation (134), 

if Xi x 2 , 2 /i I 2 / 2 - (138) 

Consequently, 

if Vi < y 2 , xj < x 2 or <r l iV2)- (139) 

Since the values of x all lie between a and b, they are bounded, and, 
by the theorem of section 27, 

lim Z -1 (y) and lim f~ l (y) (140) 

V-+VI- V-*Vi+ 

each exists as the limit of a bounded monotonic variable. 


Let the first limit be c and the second d. Then, since y = f(x) corre¬ 
sponds to x = / *(y)» and since in the last relation x —* c— asy—*yi — , 
we have in consequence of the continuity of the function/(x): 

yi = lim yi — lim /(x) =*/(c). (141) 

1/—— a?—**— 

j/i = lim j/i = lim fix) * /(d). 


Similarly, 


(142) 



LIMITS OF FUNCTIONS 


50 


[Chap. II 


This shows that/(c) = f(d) = y\ = f(x i), so that, from the relation 
(134), we must have c — d = x i. Thus 

lim r 1 (y) = hm .T'Cj/) = *1 (143) 

which shows that the functionZ -1 (y) is continuous at j/i. 

The function x = f^iy) is called the inverse of the function y = /(x), 
and we have just proved that: 

An equation y = /(x), in any interval in which the function f(x) is 
continuous and increasing, defines a single-valued inverse function , 
x = .f” 1 (#) which is also continuous and increasing . 

38. Implicit Functions. Let t/ and x be connected by an equation 
f(x y y) = 0. If this equation defines y as a function of x which would be 
written explicitly as y = F(x), then the function F(x) is said to be 
defined implicitly by f(x,y) = 0. Thus, in the preceding section we 
proved that for a certain type of function /(x), the equation y = /(x) 
implicitly defines an inverse function, which we may write explicitly as 
x—f~ l (y), A more general theorem on the existence of implicit 
functions is the following: 

Hypothesis: a) The function f(x,y) is a continuous function of the two 
variables x and y in some two-dimensional region , R } including the point 
(xQ,y 0 ) as an interior point 

b) At a particular point (x 0 ,yo), f( x oi3/o) — 0. 

c) For each fixed x — x\ in the interval a S x i Sb and for y a variable 
in the interval c g y d, the function f{x\,y) is an increasing function of 
y, Here a,b;c f d is some particular two-dimensional interval I lying entirely 
in the region R and including the point (x 0 ,yo) as an interior point. 

Conclusion: a) There is a function y = F(x) } defined in some interval 

x 0 h ^ x S %o + h, (144) 

for which yo = F(x 0 ), and/[x,F(x)] is identically zero . 

b) The function y = F(x) is continuous at all points of the interval 

(144). 

c) The function F{x) is uniquely defined in the sense that , for values of x 
such that x y F\ (x) and x,F 2 (x) each lie in the interval /, any two functions 
F\(x) and F 2 (x) satisfying the conditions in (a) of the conclusion must 
be equal 

To prove this theorem, we begin by observing that f{x^y) is an 
increasing function of so that, 

e < y 0 <d, and f(z 0 ,yo) * 0, 


since 


(145) 
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we must have: 

f(x 0 ,c) = fi < 0 and f(x 0 ,d) = / 2 > 0. (146) 

We next consider f(x,c) as a function of x, continuous at Xq. We may 
find a 5i, taking « = —/i/2 such that, 

if \x — x 0 \ < Si, | f(x,c) - /(x 0 ,c)| < (147) 

which implies that 

f(x,c) = [/(x,c) -f(x 0 ,c)] +f(x 0 ,c ) < ^ < 0. (148) 

Similarly, we may find a S 2 , such that, 

if |x — x 0 | < S 2 , f(x,d) > ~ > 0. 

JU 

We now take any positive number less than $1 and 5 2 , x 0 — a and 
b — x o as the h which defines the interval 

x 0 - h g x ^ x 0 + h. (149) 

Then, for any fixed x = xi in the interval (149), we have/(xi,z/) a 
continuous function of y which is negative at y = c, and positive for 
y == d. Hence by the intermediate value 
property it is zero for some value of y , say 
2 /i, between c and d. Moreover, by part (c) 
of the hypothesis, f(x\,y) cannot take the 
same value for two distinct values of y , so 
that the value of yi is uniquely determined. 

When applied to x 0 , the process used to 
obtain 2 / leads to 2 / 0 , by part (b) of the hy¬ 
pothesis. 

Thus there is a function yi = F(xi), or y = F(x), defined in the 
interval (149), for which 2/0 = 0 ) and /(xi,2/i) or /[x,F(x)] = 0, so 

that part (a) of the conclusion is established. 

To prove the continuity of y = F(x) at any point x f of the interval 
(149), suppose that 

lim F(x) = L 2 and Urn F(x) = Li. (150) 

at— 

Since all the values of y or F(x) lie in the closed interval c,d, the limi ts 
L\ and L% also lie in this interval, and both are finite. Next select any 
infinite discrete sequence of points x, distinct from x , in the interval 
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m 

(149) such that 

lira Xi * x f and lim F(*<) * L», (151) 

by the method used in section 24. 

Now consider f[xi,F (a*)]. Prom the way in which F(x) was obtained, 
this is zero for all x,-. But f(x,y) is continuous at the point ix',L 2 ) 
which belongs to the two-dimensional interval I, or a,b;c,d. Conse¬ 
quently we have: 

fix'M = = 0. (152) 

But fix', Fix')] = 0, (153) 

and since F(x') and L 2 each lie in the interval c,d in which f(x',y) is 
increasing, we must have 

U - F(x'). (154) 

In the same way we may show that 

Li « Fix'), (155) 

and it follows from the equality of L\ and L 2 that 

lim Fix) = Fix'), (156) 

X—K l* 

so that we have proved part (b) of the conclusion. 

finally, part (c) follows from the fact that, if [x',Fi(x')] and 
{x',F 2 (x')] each lie in /, then Fiix') and F 2 ix') each lie in the interval 
c,d in which fix',y) is increasing, so that 

fix',Fiix')] - fix',F 2 ix')] implies F x (:t') = P 2 (x'). (157) 

This completes the proof of the theorem. 

A similar theorem may be formulated for an implicit function of k vari¬ 
ables, y — Fix i, x 2 , • • •, Xk) defined by a relation/(y, x x , x 2 , ■ ■ ■, Xk) <** 
0 for values of X - (xi, X 2 , • • •, *t) near X 0 = (x 0 1 , X 02 , • • •, *ofc) 
where fiy,X) is continuous in the set of k + 1 variables in some 
(fc + l)-dimensional region including the point y,X as an interior point, 
fiyo,Xo) = 0 and in Borne (k + l)-dimensional interval, for y,X the 
function/(y,J?) for fixed X is an increasing function of y. The eonclu- 
sion is that, in some ^-dimensional interval including Xo as an interior 
point, an implicit function y - F{X) for which y 0 - FiX 0 ) is defined 
in a unique way and that the implicit function is continuous in its set of 
k variables. 

The proof is similar to that just given for k ** 1. 

The theorems still apply if we replace increasing by decreasing through¬ 
out. „ 
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1* Prove that, as n —* + oo , lim 1 jn * 0, and find a value of N such that for 
n > AT, the variable differs from its limit by less than 0.001. 

8* Prove that, as n +<x> , lim (1 + 2“ n ) = 1, and find a value of N such 
that for n> N, the variable differs from its limit by less than 0.01. 

3. Prove that, as n —> + <=©, lim 3 n = + oo f and find a value of N such that, 
for n> N t the variable exceeds 1,000. 

4. Prove directly from the definition that, if lim a t = + 00 and lim b t ~ +°° 
and if s t a< + bt and p< = a t b t , lim 8t = + 00 , lim p t = +ao, and 
lim 8 t /pt « 0. 

5* Find the limit, as n —► +<», of each of the following: 


(a) 


n 2 + 2n + 4 
2 n 2 + 1 


(b) 


3n 3 -f- 2n 
4 n 3 - 3 


(c) 


2m 

3n 2 + 4n + 1 # 


//m£: Factor out the highest power of n from each polynomial. 

0. As a generalization of problem 5, show that, if b m ^ 0, 

a m n m + H- a x n + ao a m 

lim - — — • 

n— +00 b m n m -f b m ~in m ~ l H-+ M- + 6 0 b m 


7. If, in problem 6, a m 5 ^ 0, and b m — 0, so that the polynomial in the 
numerator is of higher degree than that in the denominator, show that the limit 
is + °o if the leading non-zero terms in the numerator and denominator have the 
same sign, and — 00 if they have opposite signs. 

8. If R(n) is any rational function of n } that is the quotient of two polynomi¬ 
als, prove that lim R(n + k)/R(n) = 1. 

«—► +00 

9. If, as n •—* + 00 , lim a n « L, prove that lim (ai + o 2 + as + • • • + a*) In 
« L. Hinf: Choose k so that |L — a n | < c for n > k t let s p be the sum of the 
first p a n , and put n * fc + m. Then show that + mL — m*< s k+m < s k + 
mL + we. Now divide by n =* & +• m, and let m —* + 00 * 

10. In each of the following cases, determine the upper limit and the lower 
limit as n +00 : 


(a) n, (b) (-1)* (c) (~l)"n, (d) 1 + (~l)*n, (e) -1 + (-!)*«. 

11. Prove that lim (a t — bt) ^ lim a t - lim 6 ,. 

12* Prove that lim a t + lim b t Sa lim (a< + b t ) £5 lim a t + hm b t . 

13. Prove that if a h a%, • • * are any sequence of digits, each of which is 0,1, 2 ,3, 
4, 5, 6, 7, 8, or 9, the decimal to n places O.oicrj * * * a n is an increasing bounded 
function, and so approaches a limit. We indicate the limit by the infinite 
decimal O.aiasa* * • *. 

Conversely, show that any real number y, between 0 and 1 may be represented 
by such a sequence. The sequence is uniquely determined unless I0*y is an 
integer for some integral value of n, in which case there are two sequences, one 
ending in all zeros, and the other in all nines, after the nth place. 
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14* Show that any integer greater than one may be used in place of 10 in the 
discussion of problem 13. In particular, if the base is 2, b{ is either 0 or 1, and 
we have a binary representation 


h . 62 , b n 

-U-T~ * * * - 

2 2 2 2 » 


O.2&1&2&3 • • • t 


where the subscript after the point indicates the base. 

15* Show that, if the nested intervals of section 28 which determine the 
point A in all of them are obtained by repeated bisection, as in section 12, and 
the first interval is taken as unity for the coordinate scale, the first n steps of the 
process, or the end points of the nth interval determine the first n digits bi 
of the binary expansion of problem 14 for the coordinate of the point A. If the 
coordinate has two expansions, one qnding in zeros and the other in ones, the 
latter may have to be used. 

16. If y « x 2 ,0 S £ ^ 1, find a 5 such that |/(x") — /(.r')| S 0.1 if |x" — x'| g 8 . 

17. If y * 1/x, x 0 S x s£ 1, find a 6(x 0 ) such that |/(x") — fix') | g 0.1 if 
jx" — x'| 2s 5. Show that any 6(x 0 ) must become infinite as x 0 approaches 
zero. 

18. Prove that a polynomial in one variable is continuous for all values of x. 

19. Prove that a rational funetion or quotient of two polynomials is con- 
tinous for all values of x which do not make the denominator zero. 

20* For any real number p } let [p], read “ bracket p,” denote the algebraically 
largest integer not exceeding p. In this problem integer means positive integer, 
negative integer, or zero. Show that the function [x] and hence x — [x] is con¬ 
tinuous for all non-integral values of x, but that each function has an oscillation 
of unity at all the integral points. 

21. Show that the function x — [x] defined in problem 20 has a minimum 
value 0 but no maximum since its least upper bound, 1, is not taken on. 

22. Let /(x) be defined on the closed interval 0,1 as zero at all irrational 
points, 1 at the end points, and at any other rational value, p lq in its lowest 
terms, let f(p/q) == 1 lq. Show that this function has its oscillation at any 
point equal to the value of the function, so that it is continuous at all the irra¬ 
tional points. See section 150. 

23. Prove that, if /(x) is any polynomial and has opposite signs at the ends of 
an interval, the equation/(x) » 0 has at least one real root inside the interval. 

24. If f{x) is any polynomial of odd degree, prove that the equation /(x) * 0 
has at least one real root. 

26. If f(x) is a polynomial of even degree, with leading term positive, show 
that there is a value of x, x i)y for which fix 0 ) * m is a minimum value of the 
polynomial, that is m g» f(x) for all real values of x. Hence, show that the 
equation fix) » k will have a real root if, and only if, m. 

26. A (real) number x, such that 

a„x n + a^ix” -1 + • * * + oix + oo * 0, a» 9 * 0, 

for some positive integral value of n and for some integral values of a* in the sense 
of problem 20, is called a (real) algebraic number . Thus, at least for integral 
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coefficients (but see problem 30), the numbers obtained as roots in problems 24 
and 25 are algebraic numbers. The least value of n which can be used for a 
given algebraic number is called its degree . Show that every algebraic number 
has a degree, and that the degree is one if, and only if, the number is rational. 

27. If x, the bu and the c* are any real numbers, and 

btf? + b\X + bo *= 0 and c<& 2 + c\x + Co = 0 , 

it follows that 

& 2£ 3 + bxx 2 + box = 0 and c$x 3 + c\x 2 -1- CqX = 0 . 


Since these are linear homogeneous equations in the four variables t /4 = x 9 , 
2/3 = x 2 > 2/2 = x>y 1 = 1 , of which the last is not zero, the coefficients must have 
their determinant zero and 


£>2 b\ bo 

0 62 61 

C 2 Cl Co 

0 C 2 ci 


0 

bo 

0 

Co 


= 0, 


which is a polynomial in the coefficients. Discuss the generalization of this 
process (Sylvester’s dialytic method) of elimination to two equations, one of the 
mth and one of the nth degree. 

28. Prove that, if y is a polynomial in x with rational coefficients, and x is an 
algebraic number, then y is an algebraic number. Hint: Eliminate x by the 
method of problem 27. 

29. By the method of problem 28, or otherwise, find an algebraic equation with 
integral coefficients satisfied by y = 1 + 2 1/3 + 4 1/3 . 

30. Prove that, if a real number x satisfies an equation 

y n x n + y»-ix n ~ l H-b yix + yo = 0 , y n 5 ^ 0 , 


with algebraic numbers for coefficients, then x is an algebraic number. Hint: 
Write the equation satisfied by yo with integral coefficients and eliminate 2/0 as 
in problem 27. Similarly, eliminate the other coefficients in turn. 

31. If x and y are algebraic numbers, then x + y } x — y, x ly, and xy are all 
algebraic numbers. Hint: Use problem 30 for the first three, and for the last 
after proving that 1 fy is algebraic if y is an algebraic number. 

32. Find equations with integral coefficients satisfied by 


\/i - V2, 


V2 

V~3+ 1 


where x 2 — \' 3x + V 2 = 0 , 


by the method of problems 30 and 31 or otherwise. 

33. With each algebraic equation with integral coefficients we may associate 
a number N , the height, where N - n 4 - \a n \ + \a n ~i\ H— * + |a x { + |oo|, 
the degree plus the sum of the numerical value of the coefficients. Show that 
there is only a finite number of algebraic equations of the type considered with a 
given height, and use this fact to show that the set of real algebraic numbers are 
enumerable. Compare problem 13 of Exercises I. 
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ML Suppose that the algebraic numbers between 0 and 1 are enumerated, and 
the nth number has a decimal representation 0.Onia»$a»8 * * * as in problem 13, 
Now form a number Closes * • •, where c* » 5 if a nn * 4 and c n 4 if a»» 9 * 4. 
Since this number contains no zeros or nines, it is not a second representation of 
any terminating decimal in the list. And, since it differs from the nth number 
in the nth place, it is not a number in the list. Thus there are real numbers 
which are not algebraic. Such numbers are called transcendental . Extend this 
argument to show that no enumerated list can contain all the numbers between 
0 and 1, so that this set of real numbers can not be enumerated. (Cantor.) 

36. Peano’s Space-fitting Arc. Let t be a parameter and x and y the coordi¬ 
nates of a point of the unit square. As in problem 14, with the base 3, let us find 
infinite expressions for these numbers: t = 0.3010203 • • • , x * O. 3 & 1 M 3 — , 
and y = Q.sCiC&z * * •, where, for example, the first expression means ai/3 -f 
a*/3 2 + a*/3* + • • • • Thus all the a*, &*, and c* are 0, 1, or 2 . Let these 
numbers be associated in the following manner. We put bi « a h b 2 «* a 8 or 
2 ~ a*, according as at is even or odd; 63 « a& or 2 — a 6 , according as a 2 + 04 
is even or odd; and so on, b n * az»-i or 2 — 02 »_i, according as a 2 + a 4 + * * * 
+ is even or odd. Similarly, let ci * a 2 or 2 — a 2> according as a\ is even 
or odd; c* « <* 4 or 2 — a 4 , according as ai + a 3 is even or odd; and so on, c n ** 
02 # or 2 — 02 » according as ai + a s + • • • + a 2n ~i is even or odd. 

Show that this defines x and y as continuous functions of l } for 0 S i L 
Also, show that, for any two values of x and y each between 0 and 1, their 
expressions in the base three uniquely determine the digits a u a*, a* • • * in succes¬ 
sion and so a value of t. When the value of one or both codrdinates is a termi¬ 
nating expression, the expression ending in twos and that ending in zeros, will 
not lead to the same value of t. 

The functions x{i) and y(0 of this problem, being continuous functions, may 
be thought of as the parametric equations of an arc, which passes through every 
point of the unit square. (Peano.) 



CHAPTER III 


EXPONENTIAL, LOGARITHMIC, AND TRIGONOMETRIC 

FUNCTIONS 

The basic elementary functions are x“, p x and its inverse function 
logp x, and the trigonometric functions and their inverse functions. 
We give here a constructive arithmetic approach to these functions. 

We show that the constants in certain fundamental relations involv¬ 
ing limits are simplified if we take a special number e as our exponential 
base and as the base to which we take logarithms. We give a simple 
set of properties which characterize the exponential function e x and a 
simple set of properties which characterize the logarithmic function 
log x, when we take e as our base. 

Similarly, we show that a fundamental limiting relation involving the 
sine function is simplified by a system of units, radian measure, related 
to the special number r. We give a simple set of properties which 
characterize the sine and cosine functions, sin x and cos x, when x is 
measured in radians. 

We then briefly discuss the other direct trigonometric functions and 
the inverse trigonometric functions. 

39. Integral Powers and Roots. For any integral value of n, the 
function y = z" for any real value of z is obtained by starting with 
unity, and then multiplying by z n times. 

Let us restrict z to the range 0 g z g N. For any two distinct 
values in this range, x\ and z 2 , we have: 

z 2 - z* = (x 2 - Xx)(x 2 ~ l + a- 1 xS~ 2 + zfxj! -3 H-+ (1) 

All the terms of the last parenthesis are positive or zero, and if x 2 > z* 
the first term is greater than zero so that this last parenthesis is positive. 
It follows that, 

if x a > *2 > (2) 

and the function y = z" is increasing in the range considered. 

Again, let x t be positive and fixed, and x 2 any value such that: 

|xa — zj| < 8, where 8 < x t and 8 < 1. (3) 

Then, 

if K - xj + 1, 0 <x x <K, 0 <x 2 <K. 

57 


(4) 
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From the increasing character of the integral power, each of the powers 
in the last parenthesis of equation (1) will be increased if we replace xj 
and %2 by K. This shows that: 


I*a ~ *"! < 1*2 ~ *il nK n < SnK n . 

(5) 

Thus if we take 


< *i> < 1» 

(6) 

we shall have: 


1*2 “ *l| < «, if |*2 - *l| < So 

(7) 

so that the function y = x n is continuous for all positive values of x in 
accordance with the definition in section 30. 

For X\ = 0, and any x 2 such that: 

0 < x 2 < 6 < 1, 

(8) 

we have 


1*2 - *?! = *2 < *2- 

(9) 


Thus, when we consider values only to the right of zero, we may take 
5, * * for x\ = 0. 

Since the function x n is continuous and increasing in the closed inter¬ 
val 0 ,N, by section 37 the equation y — x n defines a single-valued 
inverse function x = ( y) which is also continuous and increasing, for 
0 £ y 2 N*. 

Since N n > N, if N > 1, we may take the y interval arbitrarily 
laige by taking N sufficiently large. 

We use y l/n to denote the function inverse to x n . Thus if y = x n , 
x = y 1/n . We note that y = x n is zero for x = 0, and lim x n — -f <*>. 

Also x * y l/n is zero for y = 0 and lim y Un = + ». 

For any positive real number p, the function x — y 1/n defines a 
number p 1/n — g, the positive nth root of p. From the inverse relation 
of x <* y 1/n and y = x n , we have q n - p. 

If we use the root function by itself, we write y = x l/n , equivalent to 
x = y n . 

40. Rational Powers. As in elementary algebra, we may now define 
rational powers of a positive real number p in terms of roots of p. We 
write 
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where m and n are any positive integers and r is any rational number. 
The relations 

(l P r Y = p", P r p" = (pp') r , and pV = p'+‘, (11) 

where p and p 7 are positive real numbers, may be proved for positive 
integral values of r and s directly from the definition of an integral 
power as repeated multiplication. They may then be proved for any 
rational values of r and s by reducing this case to that for integers, by 
means of the definitions (10). 

Suppose that the rational number r has an odd denominator. Then 
we may write r = N/D , where N is integral and D is an odd integer. 
If N is even for one such representation of r, it will be even for all and 
we write: 



N 

( — p) r = p r , r — D odd, N even 

(12) 

and 

(~ p y = -p*, r — -~i D odd, N odd. 

(13) 


Then with this extended definition the relations (11) continue to 
hold when p and p are positive or negative, if all the exponents which 
occur have odd denominators. 

41. The Exponential Function for Rational Values. Let p be any 

positive real number greater than unity. Then, for all rational values 
of x, x = r, the function p x is defined by equation (10) of the preceding 
section. We prove next that: 

As r increases through rational values , the function p r (p > 1) increases , 
and 

lira p r = 0, lim p r = 1, and lim p T = + °°. (14) 

r —►—qo r—**0 r—► + » 

For any two rational numbers r and s, we have: 

p* - p r = p r (p*" r - 1). (15) 

But, since p > 1, any rational power of p is positive, and any positive 
rational power of p is greater than unity. Consequently, if s > r, the 
right member of equation (15) is positive. This proves that the func¬ 
tion p r increases, since p* > p r if s > r. 

Let us write 

p = 1 + d, where d > 0, since p > 1. (16) 

Then, for any positive integer n, we have: 

p" = (1 + d) n > 1 + nd, (17) 

from the binomial theorem, since the omitted terms are positive. 
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Since the function p r increases, 

it r > n, p r > p n . (18) 

Consequently, if, for any positive number N, we select an integer » 
such that 

N — 1 

n > —-—» or 1 + nd> N, (19) 

a 

we may deduce from the last three relations that: 
if r > n, p r > N. ~ (20) 

This proves that 

lim p r = + 00 . (21) 

We easily deduce from this that: 

lim p r = lim p~ T — lim -4 = 0. (22) 

y~» —oo r — » +ao r—•► +oc 

let us next write, for any positive integer n, 

i 

p" - 1 + dn (23) 

where d n > 0, since p 1/B > 1 when p > 1. Then, as in equation (17), 
we have: 

1 + d = p = (1 + d n ) n > 1 + nd n . (24) 

It follows that 

d > nd n so that 0 < d„ < - • (25) 

n 

Thus 

x 

lim d n = 0, and lim p” = 1. (26) 

»—*■ +«e n—+oo 

And we may further conclude that: 

-i 1 

lim p " = Urn — = 1. (27) 

»***♦ +t© n ~+ +» 

p” 

Now, if r -»0, we may find a sequence of positive integers n, such that 
1 1 

-< r < - > n—»+* as r —►0. 

n n 


(28) 
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Since the function p T increases, this implies that 

_i i 

p n < p r < p n , (29) 

and we conclude from the last four relations that: 

lim p T = 1. (30) 

r—0 

This completes the proof of our statement concerning the behavior 
of the function p r for rational values of r. 

42. The Exponential.Function for Real Values. If a sequence of 
rational values of x, x = r, approaches a limit c, then p* or p r approaches 
a limit, as we shall now prove. The limit c may be any real number, and 
the limit of p x depends only on c, and not on the special rational sequence 
used. 

If r and s are any two numbers of the sequence, lim r — c, lim s — c, 


then lim (s — r) — 0, (31) 

so that from equation (30): 

lim p*" r = 1. (32) 

Also, beyond a certain point in the sequence, r < e + 1 so that 

p r < p c+1 . (33) 

But we have: 

P’ ~ P T - p r (p*~ r - 1), (34) 

and as the first factor on the right is bounded by equation (33), and the 
second factor approaches zero by equation (32), we deduce that: 

lim |p* — p r | = 0 as r—*c and s — r —► 0. (35) 


If we interpret this relation in terms of the fundamental definition of a 
limit, we see by the Cauchy convergence criterion of section 26 that p r 
approaches a limit as x runs through the rational sequence. We also 
see that the same limit is approached, regardless of the rational sequence 
r used, so long as r —»c. 

If the limit c is rational, we have: 

lim p T = p r , (36) 

f'~*C 

since we may then take r constantly equal to c as a sequence of rational 
values approaching c. 

If the limit c is irrational, we define p e as the uniquely defined limit 
given by equation (36). Thus this equation then holds for all real 
values of c. 
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Now let c and c' > c be any two real numbers. We may find two 
rational numbers s and s' such that c < s < s' < c'. We may also 
find two sequences of rational values, r and r\ such that: 

r—*c, r'—*c' and r < s, r'> s'. (37) 

Then, since p r is an increasing function for rational values, we have: 

p r < p\ p* < p s ’, and p*' < p r '. (38) 

On letting r and / approach their limits, we may deduce from this 
that: 

p e g p*, p"' g p e ' so that p e < p c '. (39) 

Since this is true for any two real numbers c < c', it follows that p* is 

an increasing function for all real values of x. 

Next, let x —*c through any sequence of real values. We may then 
find two sequences of rational values, r and 5, such that 

r < x < s, and r —► c, s —» c as x —♦ c. (40) 

Then, from the increasing character of p x for real values, we have 

p r <p x < p*. (41) 

But, in view of equations (40) and (36), 

lim p r — p c and lim p* = p c . (42) 

Hence, by the last theorem of section 23, 

lim p x — p c . (43) 

This proves that the function p* is continuous for all real values x. 
We may now replace the rational value r by x in equations (18) through 
(22), reasoning exactly as before, and so conclude that 

lim p x - 0, lim p* = +». (44) 

x—>► —00 x—► -fse 

Finally, by using rational sequences approaching irrational limits, 
we may extend the relations (11) so that they apply when r and « are 
any two real numbers. 

We may summarize the results of this section as follows: 

If p is any positive real number greater than unity, the single-valued 
function p* is positive and continuous for all real values of x. Asx—* — 
p* —+0; as x~* +oe, jf—* + The function is increasing for all 
values of x. 
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We may remove the restriction p > 1. We define 1* = 1, for all 
values of x. If q < 1, 1/g > 1, and we define: 

9* “ (^) > if g < 1. (45) 

Thus the first statement in the theorem applies unchanged for all posi¬ 
tive real values of p. For values q < 1, the function <f decreases for all 
real values of x, and as £ —* — <*>, (f —* + », while as z —► + =°, g* —► 0. 
Finally, analogous to equation (11), we have: 

(p*)“ = p xu , p x p' x = (pp') x and p x p u = p z+u , (46) 

where p and p' are any positive real numbers, and x and u are any real 
numbers. 

43. The Logarithmic Function. If p is any positive real number 
greater than unity, the function p x is continuous and increasing in the 
closed interval —N,N. Hence, by the theorem of section 37, the 
equation y — f(x) — p x defines a single-valued inverse function 
x = f~ 1 (y), which is continuous and increasing in the closed interval 
p~ N ^ y 2£ p N . In view of equation (44) this interval will include any 
given positive value if N is taken sufficiently large. We use \og p y, 
read “ logarithm of y to the base p,” to denote the function inverse to p x . 
Thus 

y = p z and x = logp y (47) 

are equivalent equations. 

We note that, in consequence of equation (44), 

lim log, y=— oo and lim log p y = + «, (p > 1). (48) 

y—»0 -f- y ■ ■» -f ® 

The relation (47) enables us to deduce the properties of logarithms 
from those for exponential functions given by equation (46). Thus, 


if 

= logp yi and x 3 = logp y a , 

(49) 

we have: 

ym 

- p Zl p Zt = p Xl+x ’ and x t + x 2 = log p (yi y a ). 

(50) 

That is: 

logp {yiy a ) = logp j/i + logp y 2 . 

(51) 

Also 

y u = (p*)“ *= p“ x and ux = logp y u . 

(52) 

That is: 

logp (y u ) = u logp y. 

(53) 
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la particular, from equation (53) with u - -1 and from equation 
(51); 

log* - * — log p y and logp — = logp yi - log,, y%. (54) 

y Vi 

Finally, if we take the logarithm of y to a new base P, 

X = logp y so that y =* P x , (55) 

where 

P — p v so that d = logp P, (56) 

we have: 

y = P x = (p’) x — p vX and vX — logp y. (57) 

Thus: 

logp y = logp P logp y or logp y = p~— g • (58) 

logp / 

In particular, if y = p, 

>oerp -^p- m 

The last two equations are easily remembered by their analogy with 


1 

y = p y y v pi 

p p p' p p’ p p 
v p 


(60) 


We could take a base lees than unity and carry through all our argu¬ 
ments, merely replacing increasing by decreasing and suitably chang¬ 
ing equation (48). All the other results still hold. Thus any positive 
number except unity may be used as the base of a logarithmic function. 

When considering a logarithmic function of the independent variable*, 
we write 

y — logp* equivalent to x <= (61) 


and interchange * and y in all the equations of this section. 

44. The General Power Function. For any real value of u, a power 
function *" may be defined for values of * > 0 in terms of the exponen¬ 
tial and logarithmic functions, since 

*“ » - p “ •. (62) 

Since the last expression increases with u logp *, we see that *“ 
increases with * if « is positive and decreases for increasing * if « is 
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negative. By using equations (48) and (44), we may deduce from 
equation (62) that: 

lim x“ = 0, if u > 0 (63) 

“ 4 " 

and 

lim x“ = +» if u < 0. (64) 

*—*o+ 

This makes it natural to define 0 U = 0 if u > 0 and to regard tins 
expression as undefined when u < 0 or u = 0. 

In certain limiting relations, when u is fixed and negative, the relation 
(64) may enable us to evaluate the limit. Again, if u and x are related 
in such a way that u —♦0 when x —»0, the expression x u may not 
approach a limit, finite or infinite. But, by placing suitable restric¬ 
tions on u and x, we may make the expression x u approach a, any posi¬ 
tive value whatever, as x —* 0, u —> 0. For example, 

if u = logp a/logp x, u —> 0 when x —»0 (65) 

and 

x u — a so that lim x u = a. (66) 

x —►o 4* 

46. The Derivative. The derivative of a function of x,f(x), for a 
particular value of x is the number given by the limit, as h—* 0, of 
U(x + h ) — f(x)]/h, provided that this limit exists. We denote the 
derivative of f(x) at x by f'(x), so that: 


f 


(x) = lim 

h—»U 


fix + h)-fix) 
, h 


(67) 


While we shall postpone a detailed study of the properties of the 
derivative until the next chapter, we introduce the definition at this 
point in order to explain why we are interested in certain limiting 
relations. 

In the case of the function log p x, the derivative is given by 


h 


( 68 ) 


if the limit exists. 

For any x > 0, we may write: 

log, (x + h) - log, x = log, (l + ~) “ ~ lo 8i> » (® 9 ) 

in view of the properties expressed by equations (53) and (54). 
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logp (x + h) ~ iogp x 
k 


X 



(70) 


Since the logarithm is a continuous function, the calculation of the 
limit is reduced to the calculation of the following: 


lim 

wo 



* > 0. 


(71) 


This limit does not depend on x, since if we put h = ux, the 
limit becomes: 

i 

lim (1 + «)“. (72) 

u—K) 


46. The Number e. 

u = 1/U, and consider 


To study this limit (72) further, we put 

lim (l + y) . (73) 

Itfl-MO \ U) 


For positive integral values of U, we may show that there is a limit 
by means of the theorem of section 27. We first observe that, if n is a 
positive integer, by the binomial theorem: 



l + n- + 
n 


n(n — 1) 1 
1-2 ^ 


n(n — 1) • • • 1 

TF^7 


n" 


(74) 


1 + 1 + 


(- 3 . 


2! 


+ ••• + 


n! 


(75) 


As « increases, the terms of this expression increase individually. 
Also their number increases. Thus the function increases with n. 
But the terms written in the expression (75) are less than 

l + l+ ^ + ^ + -- - + ^i = 3- ~ 7 <3, (76) 

so that 

(l + 0" < 3, (77) 

for all integral values of n, and 3 is an upper bound for the function. 
TW hv the theorem on increasing variables of section 27, the function 
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approaches a limit. We denote this limit by e and write: 


lim 

ft—*" -j-oo 


(-S'- 


(78) 


As the first two terms in the expression (75) add up to 2, and the rest 
are positive, we have: 


2 < 


(-O’ 


<3 and 2 g e S 3. 


The expression (75) suggests the sum: 

Sr 


1 + 1 HI-“4~ — *4~ * * • -4- —« 

~ 2 ! ~ 3 ! ~ n! 


(79) 


(80) 


This sum s n increases with n and has an upper bound 3, since after the 
first three each of its terms is less than the corresponding term of the sum 
(76). Thus $ n approaches a limit L, as n —> + oo. Since each term 
of the sum (80) is greater than, or equal to, the corresponding term of the 
sum (75), w T e have 

s n > (1 + ~ ) and lim s n j> e, or L > e. (81) 

\ 71 / ~ 


But, since s n approaches L, for any positive e we may find an N such that 

sa t > L - €. (82) 


And, as each term of the sum (75) increases and approaches the corre¬ 
sponding term of the sum (80), when n —+ + * o, we may find an N* > N 
such that, for n greater than N f , 


±jk±^jr) 

r ! 


> r ! N' 


r = 1,2, 


N. (83) 


Then, for any n exceeding N\ as all the terms of the sum (75) are 
positive, the sum will exceed the sum of the first N + 1 terms, so that 
in view of equations (82) and (83) we shall have 

(i + ^) n > *» - N (^) > L - 2t > N > N '- ( 84 > 

This shows that 

e > L — 2t, or e £ L, (85) 

since «is arbitrary. Equations (81) and (85) combined show that 
L — e, and e «* lim s». 


( 86 ) 
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To estimate how much we shall add to the sum s n by using » + * in 
place of n, we note that for any positive integer n: 


(» + 1 ) ! + 

(n + 2 ) I (n + k) ! ^ 

2 f 1 . 1 . . M 

(n + l )!\2 2 a ' r ' 2 v 

(87) 

and 


1 , 1 , ,1 „ 1 . 

( 88 ) 

Thus 



(89) 


Since this is true for all k, we may let k become infinite, keeping n fixed, 
and so find: 

2 

e = lim Sn+jt g s„ + 7 — —777 • (90) 

k-*+at> (n + 1 ) ! 


Since the sum s„ increases to e, we deduce from this that 

«„<«<«„ + -71 n > 1 , ( 91 ) 

n ! 

where 

l - = 1 + 1+ r\ + i i+-+fr < 92 > 


As the sum s n may be computed easily and as this sum approximates e 
to within 1 /n !, which decreases rapidly with n, the last relation enables 
us to find e numerically to any desired number of decimal places. Its 
value is 2.7181 28 

47. Other Sequences. We have shown that for any sequence of 
positive integral values of n, such that n —* +<», lim (1 + l/n)“ = e. 

Let us consider next a sequence of numbers U, integral or not, such 
that U —* + *>. For each number of the sequence, there is an integer n 
such that 


n g U < n + 1 , 

and, 

sineeP->+®, n—* + <*>. 

We deductj|rom the relations (93) that: 

1 -—-r < 1 + 7. § 1 

n + 1 L 


+ -» 
n 


(93) 

(94) 


( 95 ) 
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and since x u increases with x for fixed positive u and also increases with u 
for fixed * greater than one, we may further conclude from equations 
(93) and (95) that: 


('♦rh)‘<K)‘4*r- 


But we have: 


and 

,im o + - um o+• o + 4i) 1 

= 6-1=6, (98) 

when n and hence n + 1 become infinite through any sequence of 
integers, and in particular through the sequence defined by the relation 
(93). Hence, from the last three relations we have 

Hm (l + =e, (99) 

u-+ +« \ U/ 

in accordance with the theorem of section 23. 

Finally, consider any sequence of real values U, such that £7 —> —oo. 
We put U = — V, bo that F and write: 

But, from the relation (99), we have: 

lim ( 1 + ? i n ) v - li “( 1 + V 3 T ) ( 1 + v ^) 

- c • 1 = e, (101) 

when V and hence V — 1 —* + *>. Thus we may conclude from equa¬ 
tion (100) that 


lim 

v-+-» 




Since every sequence of values of U for which j C/j —► qo may be 
regarded as a combination of sequences for which U —► + 00 or 
it follows from equations (99) and (102) that: 
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On pitting V ■» 1 /u, we deduce that 

1 

lim (1 + u) v = e. (104) 

48. The Derivative of the Logarithmic Function. Let us now return 
to the calculation of the derivative fix), when f(x) — log,, x, discussed 
in section 45. We showed there that 

lofo^+^-jog^ _ 1 /, + >y. (105) 

h x \ xf 

As before, on putting x = ux, we have: 

;lim (\ + -V = lim (1 -f «)“ = e, (106) 

A—*0 \ #/ u—K) 


by equation (104). From this and the fact that the logarithm is con¬ 
tinuous, we deduce from equation (105) that 


lim l0gp ( x + h ) - *°gp x 
h—o h 



This proves that, 

if /(x) - logp x, f'(x) = ^ logp e. 


(107) 


(108) 


49. Natural Logarithms. When we use logarithms to simplify 
computation, we generally take 10 as the base. Logarithms to the 
base 10 , known as denary or common logarithms, have the useful 
property that the logarithm is only changed by the addition of an 
integer when the decimal point is shifted to the right. Thus we only 
need tables for the range 1 x < 10 . 

In mathematical work, where the limiting relation (107) occurs quite 
often, it is advantageous to make this equation as simple as we can. 
Consequently, we generally take e as the base, since this makes 
log,, e *■ log, e *» 1, and we may omit the factor log p e. Logarithms 
to the base e are known as natural logarithms. In computations the 
notation In x for log, x is sometimes used. Since in the sequel we shall 
almost always be using natural logarithms, we write simply log x in place 
of log, x. Ittfljus notation, the relations of the preceding section may 
be written: 

.. log (x + h) — log x 1 

yfyif) . .. . . .——.— ss — 


( 109 ) 
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and, 

if/(») “ log*, /'(*) = (110) 

X 


60. Characterization of the Logarithmic Function. Using the re¬ 
sults of the preceding discussion, which, though lengthy, has included 
a constructive approach to the logarithmic function, we may now formu¬ 
late a brief characterization of the function log x. 

The Junction log x is a function having the property: 

log x + log x ' * log xx\ (111) 


for all positive real values of x and x f } and also having the special property: 


lm. lo8(1 + ,) 

x—+0 X 


= l. 


( 112 ) 


These properties intrinsically define the logarithmic function, in the 
sense that it is possible to define a function having these properties, and 
this can only be done in one way. 

We observe that the natural logarithm of *, log * as defined in the 
preceding section, has the property (111). Also, if we replace * by 1 
and h by * in equation (109), it reduces to equation (112), so that the 
second property is also satisfied. This shows that the definition is 
possible. 

Suppose next that the function L(x ) satisfies the equation 

L(x) + L(x') = L(xx') (113) 


analogous to equation (111) and 


lim 

X—*4) 


1/(1 + x ) 
x 


1 , 


(114) 


analogous to equation (112). Then on putting x' = 1 in equation 
(113), we have: 

L(x) + L(l) = L(x) and L( 1) = 0. (115) 

Again, by putting x' = 1 + h/x, xx' - x + h and we find from 
equation (113) that 

L(* + h) - L(x) =* L (1 + *) • (116) 

But, from the equation (114), we see that 

lim £/(l + x) =» 0. 


( 117 ) 
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This shows that, when h—>0, the right member of equation (116) 
approaches zero, and hence the function L(x) is continuous for all 
positive values of x. 

By putting x f = x and then x' = x n in equation (113), we may show 
by mathematical induction that for any positive integer n: 

L(x n ) = nL(x). (118) 

It follows in particular that 

(ii9) 

n 

As n + oo the limit of the first term written may be found from 
equation (78) and the fact that L{x) is continuous. The limit of the 
last term in equation (119), as w—»+°° may be found by putting 
x *= 1/n in equation (114). We thus obtain the result: 

L(e ) - 1. (120) 

From the equation (118), we deduce that 

L(J>) = - L(x), L(J) = -L(x), (121) 

9 9 

for p and q positive integers and hence, from equation (120), 

L(e r ) = r = log (e r ), (122) 

so that L(x) has the same value as log x whenever x has a positive 
rational logarithm. Since any number greater than 1 is the limit of a 
sequence of such special values and since both functions are continuous, 


it follows that 

L(x) = log x (123) 

for all real values of x greater than unity. Finally, by putting x' — l/x 
in equation (113), and recalling that L{ 1) = 0, we have 

LQ)= -L(x). (124) 

This shows that, for any positive number less than unity, 

' L(x) - -L © = -“*(;)- l0B x. (125) 


Since L(l) = 0 =■ log 1, it follows that any function L(x) having the 
properties (113) and (114) must agree with log x for all positive values. 
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51. Characterization of the Exponential Function. We may formu¬ 
late a similar brief characterization of the exponential function. 

The function e x is a function having the property: 

eV=' = e c+x \ (126) 

for all real values of x and x', and also having the special property: 

e* - 1 

lim- = 1. (127) 

x —►O X 


These properties intrinsically define the exponential function. 

We observe that the function p x defined in section 42, with p = e has 
the property (126). If we write: 

e x ss l -f Uj log (1 + u) = x and u —> 0 as x —> 0. (128) 


Hence, 



x-*0 X 


lim 

u—►O 


log (1 + u) 


(129) 


by equation (112). This shows that it is possible to define a function 
having the two properties. 

Suppose next that the function E(x) satisfies the equation 

E(x) E(x') = E(x + x) 9 (130) 


analogous to equation (126) and 


lim 

Jr—►() 


E(x) - 1 


= 1 , 


analogous to equation (127). 

The first relation, with x' — h shows that: 

E(x + h) — E(x) = E(x)[E(h) - 1]. 


(131) 


(132) 


But, from the second relation, we see that: 

lim [£(x) - 1] = 0, (133) 

x—►O 

which shows that when h—* 0, the right member of equation (132) 
approaches zero, and hence the function E(x) is continuous for all real 
values of x. 

In particular, from equation (133) and the continuity for x = 0, we 
see that 

£( 0 ) = 1 . ( 134 ) 
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Using mathematical induction as in the preceding section, we may 
deduce from equation (130) that for n a positive integer: 

E(nx) - [E(x)] n . (135) 

From this we find: 

E = [F(x)]« and E Q = [E(x)f , (136) 

for p and q positive integers. 

Again, by putting x' = — x in equation (130) and using equation 
(134), we find that: 

E(~x) = [F(x)]" x (137) 

The equations (136) and (137) show that for any rational number r 
we have: 

E(rx) = [F(x)] r . (138) 

This shows that if we put 

p = £'(1), then E(r) = p r . (139) 

The number p must be greater than unity, since equation (131) shows 
that E(r) = p r is greater than unity for sufficiently small positive 
values of r. Since the functions E(x) and p x agree for all rational values 
of x and are both continuous functions, it follows that 

E(x) = p x (140) 

for all real values of x. 

Now put: 

p* * 1 + u, log (1 + u) = x log p, and u —* 0 as x —»0. (141) 


Then: 

so that: 


lim 


F(x) - 1 
x 

F(x) - 1 
x 


p* — 1 u log P 
X "" log (1 + u) 


log p lim 


u 


log(l + u) 


(142) 
log p. (143) 


This shows that log p * 1 and p = e, so that the function E(x) *» p* 
is identified with the exponential function e*. This proves that any 
function having the properties (130) and (131) must agree with e* for 
all real value# of x. 

It is an interesting fact that the equations (113) and (114), and (130) 
and (131) do not explicitly involve the number e. However, this 
number is determined from the first pair by L(e) « 1, and from the 
second pair by E(l) m e. 
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02. Trigonometric Functions. The reader is familiar with definitions 
of the six trigonometric functions and a derivation of their properties 
based on geometrical considerations. Such a treatment is satisfactory 
provided that it is permissible to base the definitions of functions used in 
analysis on geometrical arguments, and that the geometrical results 
used are themselves derived by sound reasoning about concepts which 
have been precisely defined. The geometrical arguments in elementary 
texts are often not of this character. In many cases the length of an 
arc of a circle not a rational part of a complete circumference or the 
number of degrees in the corresponding central angle is not defined at all. 

As it is aesthetically desirable to develop the foundations of analysis 
arithmetically, we avoid the necessity of a precise geometrical definition 
by giving a constructive arithmetic definition of the trigonometric 
functions. 

The definitions: 

sin x cos x 1 1 

tan x — -» cot x — —— > sec x =- > esc x — —— (144) 

cos x sin x cos x sin x 

enable us to define these four functions in terms of the sine and cosine 
and to reduce all theorems involving any of the six functions to theorems 
involving the sine and cosine alone. 

Accordingly, we first consider the sine and cosine, although even in 
this discussion we sometimes find it convenient to use tanx as an 
abbreviation for sin x/cos x. 

53. Determination of Values for the First Quadrant. To prepare 
for our final definition, we outline one method of assigning numbers to 
the functions sin x and cos x, for values of x in the range 0 ^ x ^ 90. 

The geometric development suggests that the numbers may be 
assigned in such a way that, for any two values of a and 6 in the range, 
for which a + b is also in the range: 

sin (a + b) — sin a. cos b + cos a sin b, (145) 

cos (a + b) — cos a cos b — sin a sin 6, (146) 

1 * cos 2 a + sin 2 a. (147) 

We shall use these equations as our guide, but shall only consider 
them proved for particular values if we can deduce this from our defini¬ 
tions. 

We begin by arbitrarily defining 

sin 90 = 1, cos 90 = 0, 
sin 0*0, cos 0*1. 


and 


(148) 

(149) 
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We then consider values of x of the special form 90/2", where n is a 
positive integer. We indicate a particular value of this kind by writing: 

90 
2”' 

We shall use s and speak of a value s to mean any one of these. We 
determine the functions of the s„ by repeated use of 

.8 11 COS 8 8 / 1 + COS 8 

sm 2 =+ V-2- C0S 2 =+ V-2- (151) 

to obtain the values of the left members. Starting with so, or 90 in 
place of 8, we determine the functions of Si, s 2 , • • ■ in succession in this 
way. 

The equations (148), (149), and (151) are all such that the relation 
(147) is automatically satisfied for the values so far considered. For 
the equations (145) and (146) we can only have a, b, and a + b all 
among the values 8 by taking a and b equal or by taking one of them as 
aero. If we take a — 0, the equations (145) and (146) reduce to 
identities in view of equation (149). If we take a = b — s/2, the 
equation (146) is satisfied because of equation (151), while equation 
(145) is satisfied because of equation (151) combined with the relation 
(147) which we established for all values of s. 

Let us next consider the function 

tan s n sin s„ 

- or -• (152) 

Sn S„ COS S„ 

To see how this function varies with n, we first deduce from the 
relations (151) with s/2 = s„, s = 2 s n = Sn—i, that 

cos 2 s n + sin 2 s n =* 1, 

2 sin s n cos s n = Vl — cos 2 s n _i = sin s*_i, 
cos 8n_i = cos 2 s„ — sin 2 s» < cos 2 s„. 

It follows from these relations that: 

tan s n _i sin 8„_i 2 sin s„ cos s„ 

. . ggm . ..—.. ess - - - - -- 

Sn —1 Sn —l COS Sn —1 2 Sn COS Sn —1 

tan s n cos 2 8„ _ tan 8» 

**- * - > -. 

COS 5ft—l 5 ii 


(153) 

(154) 

(155) 


( 156 ) 
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This shows that the function (152) decreases as n increases. Since 
it is positive, it has zero as a lower bound. Hence, by section 27, it 
approaches a limit as n becomes infinite, and we have: 

lim —!»_ 

fir- ►■+*00 Sfi 

Since, as n —> + », s n —»0, it follows that: 

lim tan s n = 0, 

n—*~foo 

and hence that: 

lim sin s n = lim (tan s n cos s n ) =0, (159) 

n —*>4-00 n—►-fee 


(157) 

(158) 


since the values of the cos s n are all at most one by equation (153). 

Using equation (153) and the fact that the cos s„ is always positive, 
we may deduce from the last equation that: 

lim cos s n = 1, (160) 

fl—►f X 

which may be combined with equation (157) to show that: 


sin s n 
hm- 

n—►-fee Sn 


= L. 


From equation (154) we have: 

sin s n _ i __ 2 sin s n cos s n sin s n 

$n —1 


(161) 


(162) 


since the cos s n is less than unity. This shows that (sin s n )/s n increases 
as n increases and therefore is always less than its limit, L. Since 
(tan $ n )/s n decreased to its limit, it is always greater than that limit. 
That is: 


sin s n 


< L < 


tan s n 
-» 


(163) 


or 


sin s„ < Ls„ < tan s nj n > 0. (164) 


We next extend our determination to values of the special form 
ms„ or 90m/2", where m is any positive integer less than 2 n . We shall 
speak of any one of these as a value t. Thus, every value s is a value t. 
Since any positive integer is a sum of powers of 2, we have 

n 

m * £ o, 2"~‘, a,- = 0 or 1, 

«-i 


( 165 ) 
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and it follows from this that: 


t 


90m ^ a t 90 

____ = £ _ 


ft 


»-i 


(166) 


This decomposition enables us to determine the functions sine and cosine 
for all the values t by a repeated use of the formulas (145) and (146). 
Each t is the sum of a number of distinct s, as the a,- are zero or one, 
which may be arranged in a definite order, that of increasing subscript. 
This enables us to prescribe a particular order of application for the 
formulas (145) and (146), for example, first for the first two terms, then 
these plus the third, and so on. 

However, the result obtained does not depend on the order. For, if 
the formulas (145) and (146) hold for 

(a + b) = a + b and (o + b + c) = (a + b) + c, (167) 

we find: 

sin (a + b + c) = sin a cos b cos c + sin b cos c cos a 

+ sin c cos a cos 6 — sin a sin b sin c, (168) 

and 

cos (o -f b + c) — cos a cos b cos c — cos a sin b sin c 

— cos b sin c sin a — cos c sin a sin b. (169) 


The symmetrical form of the results shows that the functions of 
(o + 6 + c) as computed by two applications of the formulas (145) 
and (146) will be the same regardless of the way in which we order or 
group the three terms. It follows from this that the values as computed 
for a sum of any finite number of terms will not depend on the way in 
which we order or group them. If, now, we have three different values 
of t, ti + f* *• fe and we decompose t\ and <2 into sums of s„, the func¬ 
tions of (ti -f ta), as computed from formulas (145) and (146) with 
a — and 6 ** ta will be the same as that obtained from the combined 
sum of the «„ with any other grouping. By first combining any two 
0 * of the same order which occur in h and t 2 and by repeating this until 
all the s» left are of distinct order, we finally come to a grouping of the 
sum which may, be rearranged to give that used to determine the func¬ 
tions of fj. Tffis shows that the equations (145) and (146) are satisfied 
if a, b, and 0 + b are all among the values t. 

It is now possible to extend some of our properties to the functions 
of t. Since the equations (145) and (146) imply that: 

oot* (a + 6) -f sin 8 (a -f b) ■» (cos 8 a + sin 8 a) (cos 2 b + sin 8 6), (170) 
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it follows from our method of determination that 

1 = cos 2 1 + sin 2 1, (171) 

since this relation held for the s n . 

We wish to show next that, in the range 0 < t < 90, sin t and cos f 
are always positive. 

The equations (145), (146) and (147) imply that 

sin (a + b) cos a — cos (a + b) sin a — sin b, (172) 

and 

cos (a + b) cos a + sin (a + b) sin a = cos 6, (173) 

bo that these equations are satisfied if a, b, and a + b are all among the 
values f. 

In particular, if we put a — t, b = 90 — t in equation (172), we find: 

cos t = sin (90 — t). (174) 

Let us next denote by a t of order n, a value of t which can be written 
in the form 90m/2 n , with m an odd integer, 0 < m < 2 n . Then the t 
of order n + 1 which are not of order n are values halfway between two 
consecutive t of order n, which differ by 90/2 n , or s„. The first such 
value of t is s n+ i whose sine and cosine are known to be positive. The 
rest can be obtained by adding s„ + i to some t of order n, that is, as the 
sum of a t of order n and s n+1 . Thus, if the functions sine and cosine 
are positive for all t of order n, by equation (145) the sine will be posi¬ 
tive for all t of order n + 1. Hence, since 90 — t is a t of order n + 1 if 
t is of this order, it follows from equation (174) that the cosine will be 
positive for all t of order n + 1. But the only t of the first order is sj, 
whose sine and cosine are known to be positive. Thus, by mathemati¬ 
cal induction, it follows that the sine and cosine are positive for t of 
any integral order, that is for all values of t in the range 0 < i < 90. 

From this fact and equation (171) we have: 

0 < sin t < 1 and 0 < cos t < 1. (0 < t < 90). (175) 

We may now prove that sin t increases with f. Let fi and t% be two 
distinct values of t so that: 

0 £ h < h S 90. (176) 

Then (f 2 + M/2 and (i 2 — M/2 are both values t in the range 
0 < t < 90. 

If we use these as a and 6, we find from equation (145) that 
sin fa » sin cos - ^ + cos sin (~ • (177) 
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Again, if we put o *= (f 2 — <i)/2 and 6 = h, we find from equation 
(172) that: 

• , ._/<a + *iV /h ~ h\ fh + 1{\ . (t% — t{\ 

sm = sin! 2 —) cos ( ~ 2 ~ " ~) “ cost - lain I—— J • (178) 

It follows from the last two equations that: 

sin < 2 — sin <i = 2 cos (~~7 £ sin - • (179) 


The cosine and sine in the right member are both positive, since their 
arguments are in the range 0 < t < 90. This shows that, if the rela¬ 
tions (176) hold, then sin t 2 > sin <i and sin t increases with t in the 
range 0 < t < 90. 

We next consider some limiting relations. Suppose that we have a 
sequence of values t, whose limit is zero. We may associate with each l 
of the sequence an s„, such that 


It follows that: 


t < s n , and lim n = + ». 
0 

0 < sin t < sin s n , 


(180) 

(181) 


and from this and equation (159) we conclude that 


lim sin l — 0. 

t-»o+ 

Now let t' and i" be any two values, each in the range 0 < 
Then we have: 

isin t" - sin t’\ - 2 cos sin I 


(182) 
< 90. 

(183) 


since both sides are zero if t' = t", and if t' and t" are unequal, this 
equation reduces to equation (179) with t 2 as the larger and ti as the 
smaller of t' and t". Since the cosine factor in this equation has a 
lower bound zero and an upper bound one, it follows from the last two 
equations that: 


lim jsin t " — sin t'\ = 0, if 1 1" — t 'j 0. (184) 


The last equation enables us to determine values of sin z for any real 
value of x, in the range 0 g i g 90. We note that, since we may 
find a t of order n which differs from any real number x by at most s„, 
and 8» —* 0 for » —»-f oo, there are sequences of values t for any real 
number x such that x = lim t. If t' and t" are any two terms of such a 
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sequence, each beyond the variable term t, we have two new sequences 
such that: 

lim | t n — t'\ = 0, if lim t = x. (185) 

It follows from the last two equations, and the Cauchy convergence 
criterion, that sin t approaches a limit, as t —► x. By taking the t' and 
t n in equation (184) from two different sequences, we see that the limit 
is the same for all sequences approaching x. In particular, if x is itself 
a value t> we may take t n = x in equation (184) and conclude that 

lim sin t = sin x. (186) 

t-*x 

For values of x which are not values f, we consider the value of sin x 
to be determined by equation (186). 

From equation (174), we see that if we put 

cos x = sin (90 — x), (187) 

then we shall have 

lim cos t = cos x, (188) 

l~*x 

for any sequence t such that t —> x. 

By using a sequence of values U approaching a real value Xi, and a 
sequence of values t 2 approaching a real value x 2} we may show by 
means of equations (186) and (188) that all the equations previously 
established for values t continue to hold for all real values of x in the 
range 0 g x g 90. In particular, we may establish equation (179) 
and use it to show that sin x increases, and equation (184) and use it to 
show that sinx is continuous. It then follows from equation (187) 
that cos x is continuous and decreases as x increases in the range 
0 g x g 90. 

The functions sin x and cos x, as determined by the method of this 
section for values of x between 0 and 90, are both continuous in this 
closed range. The sine increases from 0 to 1, and the cosine decreases 
from 1 to 0, as x increases from 0 to 90. 

64. The Number tt. We may extend the limit relations (157) and 
(161) to other values of x as follows. Let a, b and a + b be in the range 
0 < x < 90, and suppose that: 

sin a g La g tan a, (189) 

and 

sin b < Lb < tan 6. (190) 

Then, since 

0 < cos a < 1 and 0 < cos b < 1, (191) 
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we may conclude from equation (145) that: 

sm(o + 6 )<sina + sin6< L(a + 6). (192) 

Again, since 

0 < cos (a + 6) < 1, (193) 

we may conclude from equation (146) that: 

cos a cos 6 > sin a sin b. (194) 

It follows from this and equation (191) that: 

1 > tan a tan 6. (195) 

Also, 

tan a tan b > 0, (196) 

since sin a, cos a, sin b, cos b are all positive. In consequence of the 
last two relations, we have: 


1 > 1 — tan a tan b > 0. 

But, we may deduce from equations (145) and (146) that: 

tan a + tan b 


tan (a + b) — 


1 — tan a tan b ' 


(197) 

(198) 


We may conclude from this, and the relations (197), (189) and (190) 
that: 

tan (c + b) > tan a + tan b > L(a + b). (199) 

We may combine the result of relations (192) and (199) into: 

sin (a + b) < L(a + b) < tan (a + b). (200) 

Since the equation (164) shows that the inequality (190) holds 
when b is an s„, the argument just given shows that if it holds for all t of 
order n, it holds for all t of order n + 1. Thus starting with «i, the only 
t of the firet order, we may apply mathematical induction to show that, 
for all values of t, 

sin < < Li < tan t. (201) 

By faring a sequence of values t approaching any real value x, we 
deduce Baton this that: 

^ ran x Lx g tan x. (0 < x < 90). (202) 

If we take the relations (202) and (201) in place of the relations (189) 
Kid (190), we find by the reasoning used to derive equation (200) that 

rin (M 4« t) < LCx + 1) < tan (x + <). (208) 
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Since any real number in the range 0,90 may be written as the sum of 
another real number and a value t in this range, it follows from the last 
relation that we may omit the equality signs in equation (202). Thus 
we have, for any real x, 

sin a; < Lx < tan x, if 0 < x < 90. (204) 

This relation implies that 

81X1 

L cos x <-< L. (205) 

x 

Since the cos x is continuous, when x —> 0+, cos x —* 1, and we may 
deduce from this equation that: 


sin x 

lim -- 

x—+0 f X 


tan x sin x 1 _ 

lim - = Urn-= L. (207) 

X X— *>0-f X COS X 

The numerical value of L could be computed to any desired accuracy 
by using a sufficiently large value of n in the relation: 

S-—" <L<^. (208) 


and, in fact, was computed in practically this way by Archimedes. 

The geometric interpretation of the limit L may be seen by noting 
that, if x * 360/(2n), the perimeter of a regular polygon of n sides 
inscribed in a unit circle is 

sin x 

p n = 2 n sm x — 360 -> (209) 

x 

while that of a circumscribed regular polygon of n sides is: 

tan x 

P n = 2 n tan x = 360 - (210) 

x 

The limit of either of these expressions as n becomes infinite is 360L. 
As the length of the unit circle, defined to be equal to this common 
limit, is denoted by 2ir, we have: 

360L ** 2 ir, or L = ^» where r *» 3.14159 • • • (211) 

65. Values for Other Ranges. If we wish to have equations (145) 
and (146) hold for the values a = x, b «= 90 we must have: 

sin (* + 90) -* cos ®, cos (x + 90) ■* —sin *. 


( 212 ) 
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On the other hand, if these equations hold, we may deduce that the 
relations (145), (146), and (147) hold for a = x + 90,6 if they hold for 
o,6. Thus we may use the equations (212) to extend the definition to 
values of * in the range 90 < x g 180, and the relations (145), (146) 
and (147) will continue to hold in the extended range 0 ^ x 180. 
We may repeat this any number of times, and so define the functions 
sin x and cos x for all positive values of x. 

The equations (172) and (173), which we deduced from the three 
fundamental relations, will also hold for all positive values. If we wish 
these to hold for the values a - x,b = — x, we must have 

sin (—x) = —sin x, and cos (—x) = cos x. (213) 


Again, if these equations hold, equation (147) holds for a = —x, if it 
holds for a = x. Also, in view of the relations (213), equations (145) 
and (146) for a = y, b = —x reduce to equations (172) and (173) for 
(a + 6) = y, a = x. Thus we may use the equations (213) to extend 
the definition to negative values of x, and the three fundamental rela¬ 
tions will continue to hold in this extended range. 

Since (sin x)/x does not change when we change the sign of x, in view 
of equation (213), we have for the extended functions: 


sin x _ _ ir 

x—*o x ~ “ 180 


(214) 


66. Radian Measure. The functions sin x and cos x, which we deter¬ 
mined in sections 53 and 55, depended on the initial choice of 90 as the 
smallest positive value of x for which sin x = 1. This choice, based on 
the measurement of angles in degrees, is convenient for practical trigo¬ 
nometric computations, and is traditional in such work. 

However, any other choice would have done as well. If we had used 
the positive number q in place of 90, we could have carried through the 
entire discussion as before, and would have found the functions S q (x) 
and C a (x) related to those in the preceding section by the equations: 

S g (x) = sin ^90 ^ and C t (x) = cos ^90 0 . (215) 


For these functions, the relation (214) would be replaced by: 


lim 

jp—»’0 


Sg(x) 

X 


lim 


gin y 

gy 

90 


ir 

2 V 


(216) 


Since the limiting relation (214) occurs quite often in mathematical 
analysis, it becomes worth while to simplify it by a suitable choice of q. 
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We do this by taking q » r/2, which reduces the right member of 
equation (216) to unity. 

Since ir/2 is the length of a quadrant of a unit circle, this choice corre¬ 
sponds to the geometrical measure of central angles by the arcs they 
subtend on a unit circle, or by the arcs they subtend on any circle 
measured in terms of the radius. Hence this is called radian measure . 
From now on we shall use radian measure exclusively, and use sin x to 
mean S q {x), with q = tt/2. When we wish to use S q (x) with q = 90, 
the function determined in section 55, we shall write sin x°. Thus, we 
have with this notation: 


sin x = sin 



(217) 


from which we can obtain the function of x for radian measure if we have 
tables of these functions for x in degrees. 

With the new notation, the limiting relation is: 


sm x 

Iim- 

x-H) X 


= 1 . 


(218) 


The inequality (204) may now be written : 


sin x < x < tan x, 


if 0 < x < ^ . 

I* 


(219) 


67. Characterization of the Functions sin x and cos x . Using the 
results of the preceding constructive discussion, we may now formulate 
a brief arithmetic characterization of the functions sin x and cos x. 

The functions sin x and cos x are two functions hating the following 
properties: 

sin (x + x f ) = sin x cos x f + cos x sin x', (220) 

cos (x + x') = cos x cos x — sin x sin x' } (221) 


cos 2 x + sin 2 x = 1, 

for all real values of x and x f , and the special property: 


sm x 

lim - — 1. 

x — »0 X 


( 222 ) 

(223) 


It is possible to define the functions for aU values of x so that these proper¬ 
ties are satisfied, and there is only one way of doing this. 

The functions sin x and cos x of the preceding section have these four 
properties. We shall now show that any other pair of functions having 
the four properties must be identical with sin x and cos x. Accordingly 
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we consider two functions S(x) and C(x) which are defined for all real 
values of x, and which satisfy the relations: 

S(x + *') - S(x) C(x') + C(x) S(x'), (224) 

C(x + *') = C{x) C(x') - S(x) Six'), (225) 

C\x) + S\x) = 1 , (226) 

and 

lim = 1. (227) 

x—+-0 X 

From the last relation, S(x) must be different from zero for some value 
of x. Let x have such a value, and put x' = 0 in equations (224) and 

(225) . The result is: 

S(x) = S(x) (7(0) + C(x) S( 0 ), (228) 

C(x) = C(x) (7(0) - S(x) S( 0). (229) 

It follows from these equations that 

S(x) {[(7(0) - l ] 2 + S 2 ( 0 )} = 0 , (230) 

or, since S(x) is different from zero, 

(7(0) = 1 and S( 0) = 0. (231) 

Again, from the relation (227), S(x) must be distinct from zero for 
sufficiently small values of x, 0 < ja:| < hi, so that 

lim S(x ) = lim x — 0. (232) 

x~+0 x~+0 X 

By reasoning from equations (224), (225) and (226) as we did in the 
derivation of equation (179), we may prove that: 

8(za) - S(x x) - 2 C • (233) 

Since the values of C(x) never exceed 1 numerically, by equation 

(226) , the right member of equation (233) approaches zero if xj — xi 
approaches zero, in view of the relation (232). Thus, if xi is fixed, and 
x$—*xi, S(xd 8(xi) and the function S(x) is continuous for all 
values of x. 

We may also deduce from equations (224), (225) and (226) by a 
argument t ha t: 

C(x a) - C(xO - —28 (™p) S (pp) * 


(234) 
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from which we may infer that the function C(x) is continuous for all 
values of x. 

Since C( 0 ) = 1 , there is some interval 0 < x & h 2 throughout which 
the functions S(x) and C(x) are both positive, in view of the continuity 
at zero, and the relation (227). Put 

x Al _ 180 90 

r n = so that — r„ - — = (235) 

and r n radians corresponds to s n degrees. Since r n is positive, and when 
« becomes infinite r„ —> 0 and hence sin r„ —» 0 , we may find a value of 
n, say N, such that 

0 < sin r N < S(h 2 ). (236) 

Also, since the function S(x) is continuous in the closed interval 0 ,h 2 
and sin rjv is an intermediate value, it is taken on. Thus there is 
some value, h, in the interval 0 ,h 2 for which 

S(h) - sin rjv. (237) 

Since C ( h ) is positive, and satisfies equation (226), we must have: 

C(h) = cos rx- (238) 

But it follows from equations (224) and (225), with x — x , that 

S(2x) = 2 S(x) C(x) and C(2x) = C 2 (x) - S 2 (x). (239) 

Since the functions sin x and cos x satisfy similar equations, it follows 


that 




S(2 N h) — sin (2 n tn) = sin ^ = 1, 

It 

(240) 

and 




C(2 W A) = cos (2 N rx) = cos^ = 0. 

It 

(241) 


Again, from the second equation (239) and equation (226) we may 
deduce that: 




Since these are similar in form to the equations (151), and the values 
of S(x) and C(x) are positive for all x between 0 and h, it follows that 

S « sin « sin s^, and C = cos s^+*. (243) 
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(2 N hx\ . B (2 N hx\ 0 , 

S 1—^—1 = sin x° and C f) = cos x°, (244) 

whoever a: is of the form s„. And, since the addition theorems (224) 
and (225) hold, the equations continue to be valid whenever a: is a 
value t. Finally, since all the functions involved are continuous, the 
equations must hold for all real values, at least in the range 0 sf x g 90. 

It follows from the addition theorems and equations (240) and (241) 
that 

S(x + 2 N h) = C(x) and C(x + 2 N h) = -S(x). (245) 

By comparing these equations with equation (212), we see that equa¬ 
tion (244) is valid for all positive values of x. 

From the equation (231) and the three fundamental relations we 
may deduce that 

S(-x ) = -S(x) and C(-x) = C(x), (246) 

by reasoning analogous to that used in connection with equation (213). 
Since equation (246) has the same form as equation (213), it follows 
that the equations (244) are valid for all values of x. 

From the limiting relation (214), we have: 



But, if we put u = 2 N hx/90 and use the relation (227), we find: 


lim — 

X —+-0 



2 s h S(u ) 

lim —- 

*-*o 90 u 


2H 

'90 ' 


(248) 


A comparison of these last two relations gives: 

ir , 2 N hx 

2 h = - > so that u — - 

2 90 


tx 

180’ 


(249) 


and hence by equations (217) and (244) : 


. /I80u\° . , . 

sm l- J - sm u, and C (u) == cos u. 


(250) 


This proves our contention that any pair of functions satisfying the 
four stated relation must be identical with sin x and cos x for all real 
values of x. 
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It is an interesting fact that the original conditions made no explicit 
reference to the number tt, but that these conditions determine x/2 as 
the smallest positive number for which 

& ^2) ** ^ an( ^ ^ (2) ~ ^ (2S1) 

68. Properties of the Trigonometric Functions. From our present 
point of view, all the formulas involving functions of the sum or differ¬ 
ence of x and an integral multiple of x/2 follow from the addition and 
subtraction theorems, and the fact that: 


• T 1 * A 

sin - - 1, cos- = 0. 
2 ' 2 


In addition to the relations: 

sin 0 = 0, cos 0 = 1, sin ( — x) = — sinx, cos (—x) = cosx (253) 


sin ^x + ^ = cos x, cos ^x + 


which are essentially those already used to extend the range of definition 
beyond the first quadrant, we note that 


cos x = sin 




We easily find from equation (252) and the addition theorems that: 

sin x = 0, cos x = — 1 ; sin 2x = 0, cos 2x = 1. (256) 


Since the functions of 2x are the same as those of 0, the addition 
theorems show that x + 2x has the same functions as x + 0, or x. 
Thus the sine and cosine each admit the period 2x. It is the smallest 
period for the cosine, since no value between 0 and 2x has cos x — 1. 
It is the smallest for the sine, since the only value between 0 and 2x 
which makes sin x = 0 is x, which is not a period since sin (x + x) = 
—sin x. 

Similar reasoning shows that the tangent and cotangent each admit x 
as their smallest period. 

We have shown that many of the identities involving the sine and 
cosine derived in elementary trigonometry hold for the functions as 
defined in section 56. Since all the remaining identities involving the 
sine and cosine can be derived from those here proved by algebraic 
means, we shall feel free to use any of their elementary properties in the 
sequel. 
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Identities involving the other functions may be considered identities 
in the sine and cosine, in view of equations (144). 

69. The Derivative of die Sine and Corine. The derivative of the 
function sin *, in accordance with the definition (67) of section 45 is 


sm (x + h)— sin x 

Inn---. 

h -*0 ft 


if this limit exists. 

But from equation (179) or (233), 


sin (x + h) — sin x = 2 cos 


(*+i) 


am- 


so that: 


sin (* + h) — sin x 
h 



(257) 


(258) 


(259) 


Since the cosine is continuous, the first factor approaches cos* 
when h —»0. The second factor approaches unity, by equation (218). 
Thus the limit is cos *, and we have: 


If/(x) ** sin *, then /'(*) = cos *. 

In a similar way, using the equation 

/ h\ h 

cos (* + h) — cos * = —2 sin I * + -1 sin -> 
we may show that 

.. cos (* + k) — cos x 

hm---— —sm *, 

A —*0 ft 

so that: 

If/(*) = cos *, then f'(x) = —sin *. 


(260) 

(261) 

(262) 

(263) 


60. Inverse Trigonometric Functions. Since the continuous func¬ 
tion y ■» sin * increases from — 1 to 1 as * increases from —v/2 to ir/2, 
the inverse function * = sin -1 y is continuous, and increases from 
—»r/2 to increases from — 1 to 1. This is the principal branch 

of the function x * sin -1 y. Other branches are obtained by taking 
other infinnds, (n - 1/2)* to (ft + 1/2)*, where « is a positive or 
negative integer, in which the sin x either increases from — 1 to 1, or 
decreases from 1 to —1. Collectively, the branches make up an infin¬ 
itely many-valued function sin -1 y. 
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In any application where y varies in one sense within the range —1,1 
we may restrict ourselves to one branch, and usually find it convenient 
to use the principal branch. Where y varies in some other way, for 
example increasing to 1 and then decreasing, we may either use intervals 
in which y varies in one sense, and treat these intervals separately; or 
we may regard the relation x — sin -1 y as equivalent to the relation 
y = sin x, and use such branches for the different intervals that x varies 
in one sense as y increases to 1 and then decreases. 

Similar reasoning shows that the functions cos -1 y, tan -1 y, cot -1 y, 
sec -1 y and esc -1 y are continuous and monotonic in certain restricted 
ranges. 

The values of the principal branch of the esc -1 y are those in the range 
— r/2 gig ir/2. In fact esc -1 y = sin -1 (1 /y). 

For cos -1 y and sec -1 y = cos" 1 (1 /y) the values of the principal 
branch are those in the range 0 g i g x. 

For the functions tan" 1 y and cot" 1 y — tan" 1 (1 /y) the values of the 


principal branch are those in the range 
We note that for this branch, 

- ir/2 gig x/2. 


tan" 1 (— co) = — ~ and 

Z 

tan" 1 (+ 00 ) = Y 

(264) 

in the sense that if 



x = tan y and y — tan" 1 x, 

IT 7T 

and 

z z 

(265) 

then 



x _> _ oo as y —* — ^ +, and 

A 

f T 

x —> + oc as ?/ —► - — 

Z 

(266) 

Since 

lim tan x = + °o and 

lim tan x = — oo, 

—► 5 -L 

2 ‘ 

(267) 

we can only write 

lim |tan x\ - 

* 00 9 

(268) 

£ 

and the notation sometimes used, tan ir/2 = <*> or tan x/2 = 

zk oo, 


must be interpreted as meaning no more than the last two equations. 
S imil ar remarks apply to the notation esc 0 = « and sec ir/2 = <x>. 
61. Polar Coordinates. Let x and y be the Cartesian coordinates of 
a point in a plane, as in section 13. The polar coSrdinates of the point 
may be defined as any pair of values r,6 satisfying the relations: 

r ^ 0 and x «*> r cos 0, y = r sin 0. 


(269) 
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We proceed to discuss the solutions of this system of equations. The 
equations imply that 

x 2 + V 2 — t 2 , and r = + V x 2 + y 2 . (270) 

Thus the value of r is uniquely determined. Geometrically it is the 
distance from the point to the origin. 

If x and y are both zero, r is zero and 0 
is unrestricted, since if x = y = r — 0, any value 
of 0 will satisfy the equations (269). 

For x and y not both zero, r is positive, and the 
value of 0 must then satisfy 

cos 0 = -» sin0 = -- (271) 

r r 

If x = 0, since r 0, y 0. If y > 0, 0 = ir/2 will be a solution, 
while if y < 0, 0 = —v/2 will be a solution. 

If x 0, then 0 must satisfy the relation: 

tan 0 = - or 0 = tan -1 - • (272) 

X X 

This relation determines a unique value of 0 O in the interval 
— -jt/2 < 0 < t/2, the value for the principal branch of the preceding 
section. This value 0 O will either satisfy the equations (271) and (269), 
or will be such that 6 0 + w will satisfy them. Thus the equations 
(269) have a unique solution in the interval — 7r/2 ^ 0 < 3x/2, when¬ 
ever r^0. 

Since cos 0 and sin 0 each admit the period 2x, there will be a unique 
solution, if r 0, in every interval 

a ^ 0 < a + 2x or b < 0 g b + 2t, (273) 

and if 0i is one solution, all the solutions will be given by 0 = 0 X + 2Jcir f 
where k is zero or a positive or negative integer. 

Geometrically, r is the length of the radius vector, and 0 is the angle 
measured from the positive x-axis to the radius vector. We shall refer 
to (r,0) as the polar coordinates of the point with Cartesian coordinates 
We have thus proved: 

If a point has Cartesian coordinates (x,y) distinct from (0,0), the relations 
x « r cos 0 and y = r sin 0, r > 0 (274) 

determine uniquely a pair of polar coordinates rfi in the range 

a £ 6 < a + 2r, 



Fiq. 8. 


determined by a. 


(275) 
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EXERCISES m 

1. For what real values of x does x x define a real number? For what values is 
this function continuous? For what values of x and y is x v a continuous func¬ 
tion of the two variables? Similarly for (x 2 ) v/2 ? 

2. An explicit algebraic expression is one built up of one or more variables 
and constants by the four fundamental operations, together with root extrac¬ 
tions. Prove that such an expression is continuous for any set of values of the 
variables which does not make a denominator zero, or an expression whose even 
root is taken zero or negative. 

3. Prove that lim (1 + x/ri) n = e T . Hint: Put n - xjh, when x 9 ^ 0. 

n -" » {- oo 

4. Show that if x > 0, the function 

Sn(x) =1 +X + £+---+ — 

2 ! n ! 


for fixed x increases with n, and approaches a limit as n —» -f oo. Hint: To 
obtain an upper bound, note that if m > 2x, the terms from the mth to the 
(m + fc)th do not exceed 


x m 

rn ! 


S + \ + h + 


+ 



3s m 
m ! 


6. Prove that e z = lim (1 + x + x 2 /2 ! + * * • x n /n !), if x > 0. Hint: 

n—►-foo 


Use problems 3, 4 and argue as in section 46. 

6. Prove that, if lim [fix + 1) — /(x)] = L, then lim f(x) /x = L, if fix) 


►-foo 

is bounded on every finite interval. Hint: If a < fix + 1) — fix) < 6, for 
^ ^ , x M \ ^ L j an + f{x) f(x + n) bn + fix) 

x + n x + n x + n 

For x f < x :g x* + 1, j/(x)| < M, and hence, for n > n', 

a — € < fix + n) / (x + n) < b + €. Now find x' for a = L — e, b = L + €, 
so that for any y > x' + n', y = x + n with n > n' and x' < x ^ x' + 1. 
Hence lim fiy) /y = L. 

7. Show that the boundedness condition of problem 6 is necessary by con¬ 
sidering fix) = cot 7tx, x n an integer, and/(x) = 0, x an integer or zero. 

8. Prove that if lim [fix + 1) — /(x)] = +°°, and fix) is bounded from 

35—►-f-00 


below on every finite interval, lim fix) /x = + 00 . 

9* If f(x) is bounded on every finite interval, and as x —» + «>, the upper and 
lower limits of fix + 1) — fix) are B and A respectively, while those of fix) /x 
are B ' and A', show that A 5* A f 5* B f £ B. Consider sin 2 irx as an example. 

10. Show that problem 9, Exercises II is a special case of problem 6, and 
formulate extensions of that problem analogous to problems 8 and 9. 
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UL Prove that, if f{x) is positive and together with 1 //(x) is bounded on every 
finite interval, and lim f(x + 1) //(x) = L > 0, then lim f(x) l/x = L. Hint: 

so 1 "**} i 00 co 

Apply problem 6 to F(x) « log/(x). 

12, Formulate extensions of problem 11, based on problems 8 and 9. 

18. Prove that, if f(x) is positive and bounded on every finite interval, and 
lim f(x + 1) /f(x) = 0, then lim /(x) l/ * « 0. This is an extension of prob- 

as—►+*» j — » ■ ) co 

Jem 11. 

14, Prove that e z > x n jn !, for any x > 0, and n a positive integer. Deduce 
that lim e z x~ n = + ®o, as n + 00 , Hint: Use problem 5. 

16. Prove that lim x u e~ x = 0 for any real u. Hint: Use problem 14, or 

a ? “ - »-f-oo 

problem 13 for the case u > 0. 

16. Prove that if u is any real number, and p> 1, that lim x u p~~* * 0. 

*—■►+-oo 

Also that lim (log y) u /y = 0. Hint: Put y = e* and use problem 15. 

ir-H-oo 

17. Prove that for any real value of u and any positive value of m, 
lim (1 og y) u /y m = 0, and lim (log y) u y m = 0, Hint: Use problem 16. 

y ■ ■> { co y—► +-00 

18. Prove that lim y/x = 1, and hence that lim x x « 1. Take 

►Hh°o 

logarithms and use probiein_16. . 

19. Prove that lim v'n ! = -f «o. J/inJ: By problem 14, V'flTi > xe~* /n 

n— oo 

«» n /e if x = n. 

20. Prove that lim n(x l/n — 1) = log x, if x > 0. Hint: Put n = 

n—►+-«> 

(log x) /A, and use equation (127). 

21. Prove that lim ; g /( z ) if * > o, g(x) if x < 0 and 

n—+«> e nz + 1 

1/(0) + ff(0)]/2 if x = 0. 

22. The function sgn x, read “ signum x,” is defined to be 1 if x is positive, — 1 

£>n* _ J 

if x is negative, and sgn 0=0. Prove that lim -- sgn x. Also prove 

»—►+-00 -f" 1 

2 

that lim - tan” 1 nx * sgn x, if the principal branch is used. 
it 

23. Prove that lim sin mrx = 1, and Urn sin tittx = — 1, if x is irrational and 
nr-* + 00 through integral values. Hint: Use problem 32, Exercises I. 

2 

24. Show that if /(x) * lim lim - tan” 1 [m sin 2 (n I«)], then/(x) «* 1 

n—►-|-oo m—►+*00 7T 

when x is irrational, and 0 when x is rational. 

25. ShoWjthat if fix) * lim lim cos’* (n 1 irx), then /(x) -> 0 when x is 

H—►+*» m .► 4 °0 

irrational, and 1 when xfi, rational. 
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26. Show that the function sin (l lx) has its oscillation equal to 2 for 
x *** 0. See section 160. 

27. Prove that for any real value of u and any positive value of m, the function 
(x z ) m sin (x 2 ) u is continuous at x - 0 if, for u < 0, we define the value of the 
function to be 0 when x = 0. 

28. Suppose the function f(r) is defined for all rational values on a finite 
interval, and is uniformly continuous in the sense that, for any two rational 
values on the interval, |/(r") — /(r')| < e, any positive quantity, if |r" — r'| < 8 
depending on t. Prove that there is one and only one function /Or), continuous 
for all values on the interval, and such that f(x) = f(r) when x is a rational 
number r. 

29. Show that /(r) = 3r, 0 ^ r fg 2, is an example to which the preceding 

problem applies to give f(x) - 3x, but that the function /(r) «--- 

7 r 

sin 

may not be extended to a function continuous for all real values between 0 and 2, 
even though it is continuous at all the values r, in the sense that iim /(r) — 

r—►r' 

30. Prove that the result of problem 28 remains valid if the values r are 
replaced by any set of points on the interval such that every point of the interval 
is a limit point of the set. As examples of such sets we have that in problem 32, 
Exercises I, and the set 90m/2 n used in section 53. 

31. If f{x) is defined for all real values of x, is continuous at one point, and 
satisfies f(x + y) = /(x) + f(y), then f(x) ~ kx. Hint: Since f(x + h) — 
f(x) = f(h), which does not depend on x, continuity at one point implies con¬ 
tinuity at all points. But if p and q are positive integers, it follows by induction 
from the original equation that f(p) — pj{ 1), and qfip/q) = f(p). Hence, if 
/(1) = k, f{r) = hr for r a positive rational. The equation also shows that 
/(0) = 0 and f(—x) = —/(x), so that r may be zero or a negative rational 
number. Finally, by problem 28, /(x) = kx. 

32. If f(x) is defined for all positive values of x, is continuous at one point, and 
f(%V) * f(x) + f(y)> then f(x) = k logx. Hint: Apply problem 31 to F(u) = 
/(logu), where x «= logu. 

33. If f(x) is defined for all values of x, is continuous at one point, and 
J(x + y) «» /(x)/(2/), then f(x) *= A x . Hint: If /(x) is zero for one value it is 
always zero. If not, since f(x) = [f(x /2)] 2 , all the values are positive, and we 
may put F(x) «= log/(x) and use problem 31. 

34. Prove that none of the expressions: 

sin 7rx 1 1 + x sknrx 

sin 7rx 1 + x sin irx x + x sin irx 

approach limits as x-~* +<», but that on any sequence including no integral 
values of x, the limit of the first is 1. 

sin ax tan ax 

36. Prove that as x •—> 0,-and-each —> a. 


T-V2 
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sin” 1 ax tan” 1 ax 

38. Prove that as x —► 0,- and - each — > a. Hint: Put ax 

x x 

sin y; ax « tan y . 

1 *—■ cos x 1 

37. Prove that lim -r— = - . Hint: Use either (1 — cos x) 

jp—»- o x 2 2 

sin 2 x , m /x\ 

— - y or 1 — cos x == 2 sin 2 1 ~ I * 

1 4* cos x \2 / 


cos X 

38. Prove that lim —--= 1. 

x—*>r/2 7T /2 X 




CHAPTER IV 


DIFFERENTIATION 


In this chapter we shall study the special limit process, differentiation, 
which plays a central role in the differential calculus. We outline the 
fundamental theorems on differentiation, with particular emphasis on 
those points which are apt to be inadequately treated in a first course. 

We then proceed to the mean value theorem, and various theorems 
about derivatives and applications of differentiation related to it. 

62. Definitions. If y = /(x) is a function of x, the derivative of the 
function for a particular value of x, is defined by 


f'(x) — lim 
h-+ o 


f(x + h) - f(x) 


( 1 ) 


as we stated in section 45. 

As the denominator of the fraction, h, is an increment of x, it is fre¬ 
quently denoted by Ax, and the numerator, being an increment of y is 
denoted by Ay. This leads to the more condensed form of the definition: 


f(x) = lim — • (2) 

Ax— ►() Ax 

This does not indicate which value x is being considered, unless supple¬ 
mented by 

Ay = f(x + Ax) - }{x). (3) 

The alternative notation for a derivative, 

y or A ( y ) in place of fix), (4) 


is intended to suggest the defining relation (2). 

We recall that the notation h —> 0 or Ax —* 0 implies that h or Ax 
may approach zero through any sequence of values, each of which may 
be positive or negative but may not be zero. 

To say that the function/(x) has a derivative at x usually means that 
for this x, the difference quotient which appears in equation (1) 
approaches a finite limit. In this case the difference in the numerator 
must approach zero with h, so that the function f(x) must be continuous 
for the value of x considered. 
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However, if the function/(x) is continuous at x, and for this value the 
limit in equation (1) is plus infinity, we say that/(x) has the derivative 
-f «. Similarly, if the limit is — «, we say that/'(a;) =»—«>. When¬ 
ever we wish to include these cases, we shall use the phrase, /(x) has a 
finite or infinite derivative. Note that, in all cases where /(x) has a 
derivative, finite or infinite, /(x) is continuous. 

The interpretation of derivative as a slope makes it desirable to include 
infinite derivatives, as here defined, since the question of a function 
having a derivative is then related to the question of its graph having a 
tangent. Geometrically, an infinite derivative merely means a vertical 
tangent, and so may be introduced by a mere rotation of axes. 

If A is restricted to be positive and if the limit in equation (1) is 
obtained, this limit is called a right-hand derivative. Similarly, if A is 
restricted to be negative, the limit is a left-hand derivative. For 
example, if y = |x|, for x = 0, the function has a right-hand derivative 
equal to +1, and a left-hand derivative equal to —1. In the original 
sense, this function does not have a derivative at x = 0. 

The process of finding the derivative of a function is called differentia¬ 
tion. We say that a function may be differentiated in a closed interval 
a g x :£ b, if the function has a derivative at all interior points, a right- 
hand derivative at a, and a left-hand derivative at b. The function 
f (x), obtained from a function by differentiation, is sometimes called 
the derived function. 

63. Combinations of Functions. In view of the results of section 19, 
the definition of a derivative implies that the operation of differentiation 
is linear. That is, if u and v have finite derivatives, and A is a constant, 
then 




(5) 


and 


dx 


(u + v) 


du dv 
dx dx 


( 6 ) 


It may be deduced directly from the definition that 



d , . dv , du 

-M -«£ + •£• 


du dv 

V — — U — 

dx dx 

v* 


t if v 9 * 0. 


(7) 


d_/u 

dx\v t 


( 8 ) 



A»r. 64] 


INVERSE FUNCTIONS 


99 


It also follows immediately from the definition of a derivative that 


dx 

dx 


1 


dk 

and — = 0, 
dx 


(9) 


where k is a constant. 

The equations of this section enable us to derive the familiar formula 
for differentiating any polynomial: 

If f(x) = £ a p x p , f'(x) = £ pa,#*- 1 . (10) 

V “0 1 


By using equations (8) and (10) we may find the derivative of any 
rational function for a value of x which makes the polynomial in the 
denominator different from zero. 

64. Inverse Functions. We proved in section 37 that, if y — fix) is 
a continuous increasing function in some open interval including xo, 
there is an inverse function x = f~ l (y), which is continuous at yo, 
where yo = fix o). Let us assume in addition that /(x) has a derivative 
at x 0 , finite and distinct from zero. Then 


/'(so) = 


dy 

dx 


y 

lim —> 
ax— o Ax 


(ID 


where Ax is the increment of x at x 0 , and Ay is the corresponding incre¬ 
ment of y at 3/o- 

Since the inverse function (y) is continuous at y 0 , when Ay 
approaches zero, Ax also approaches zero. Also since the function is 
increasing, Ay is distinct from zero if and only if Ax is. Hence: 



Ay 


lim — -- 

a*—o A y Iim Ay 

AjX ax—0 X 


dy 

dx 


( 12 ) 


This shows that x = f~ 1 (y) has a derivative, and 

dx _ _1_ 
dy dy 
dx 


(13) 


If Six) has the derivative equal to zero, then (y) has the deriva¬ 
tive -(-<», while if f(x) has the derivative + °°, then f~ 1 (y) has its 
derivative equal to zero. These facts follow from the relations (12) 
and the remarks in section 20, since Ax and Ay have the same sign. 

A similar discussion applies to decreasing functions. Here the inverse 
function has the derivative — «, if the original function has its deriva¬ 
tive zero. 
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66. Composite Functions. Suppose that u — /(x) has a finite 
derivative at x 0 , and that y = g(u) has a finite derivative at u 0> where 
«o = /(xo). Then the function 

y = glf(.x)] = F(x) (14) 

has a derivative at x 0 , given by 

F'fro) = g'Mf’ixo) or (15) 

ax du ax 

To prove this, we first consider the case in which for all Ax 5 ^ 0 the 
corresponding values of Au are never zero. In this case we have: 

Ay Ay Au 

— = — —, (16) 

Ax Au Ax 


and the relation (15) follows by taking limits, after noting that when 
Ax —»0, then Au —► 0, so that 


Ay Ay dy 

lim — = lim — = — • 
Ax—*-0 Au Au—K) Au au 


(17) 


This proof also applies if there are not arbitrarily small values of 
Ax, say AiX, distinct from zero, for which Au = 0, since in this case the 
Au will be different from zero when Ax is different from zero and 
sufficiently small. 

Now consider the special case in which there are arbitrarily small 
values of Ax, AiX 0, for which Au = 0. Then, on letting Ax approach 
zero through such values, we find 

Au 

lim — = 0 . (18) 

AiX 


But, since u has a derivative, the limit must be the same for all 
methods of approach of x to zero, and 


du ,. Au 


(19) 


If we let Ax approach zero through values Aix, we have Au = 0, so 
that Ay — 0, and hence: 


lim — = 0 . 
Aix 


( 20 ) 


On |be other hand, if we let Ax approach zero through values of 
Ax not of the type AiX, say A 2 x, we have: 

Aw Ay Au 
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so that, in view of equation (19), 

dlJL 

Thus, in the special case where there are sequences Aix, 

lim — = 0, 

Ax 


( 22 ) 

( 23 ) 


whether Ax approaches zero through sequences Ajx or A 2 x, and hence 
through sequences composed partly of one type and partly of the other. 
That is, the limit is zero for all methods of approach. 

Finally, since in the special case, 

dy du 

S- # “ d (24) 


while dy/du is finite, we have 


dy = = dy du 

dx du dx' 


( 25 ) 


bo that the relation (15) also holds in the special case. 

A trivial example of the special case, where all values of Ax are AiX, 
is the case where f(x) = k, a constant. A better example is given by 
f(x) = x 2 sin (l/x)ifx 0, and/(0) = 0; g(u) = 2uwithuo = *0 = 0. 
Here the values A x x are l/(nir), where n is a positive or negative integer. 
Compare equation (70) in section 69. 

66. Logarithmic and Exponential Functions. We showed in section 
49 that 

j- (log x) = - • ( 26 ) 

ax x 


Since the function y — log x is increasing, we may find the derivative 
of its inverse function x = e v by equation (13), and 


d_ 

dy 


(?) 


1 


£(logz) 


= x = e*. 


( 27 ) 


If we now interchange x and y, this becomes: 


A 

dx 


(e*) 


e*. 


( 28 ) 


We may write 


if r > 0. 


(29) 
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If u and v are functions of x with finite derivatives, we find from this and 
equations (28), (16), (7), and (26) that: 

£(»*)=»■ log + |. (30) 

As particular cases of this, we have: 

■£ (p x ) = P x log p, p > 0, (31) 

where p is any positive real number, and 

^ (x k ) = kx k ~ 1 , x > 0, (32) 


where k is any real number and x is any positive number. This formula 
remains valid for negative values of x if k is a rational number with an 
odd denominator, as we may show by using the equations (12) and (13) 
of section 40. For any value of k > 1, the function x k has a right-hand 
derivative 0 at x = 0, as a direct application of equation (1) shows. 
Thus whenever the right member of equation (32) is finite for x — 0, it 
equals the value of the right-hand derivative. 

The special result 

A(*->).-A, 1*0, (33) 


may be combined with equations (15) and (7) to give an alternative 
derivation of equation (8), since u/v = uv~ l . This point of view is 
sometimes convenient in differentiating a fraction. 

The method of logarithmic differentiation consists in taking the 
logarithm of a function before differentiating. The derivation of equa¬ 
tion (30) from the relation (29) was equivalent to this method. For 
example consider the product: 


We find: 


y = UiU 2 «3 •••««• 


(34) 


so that: 


« 


log y = L log Ui, 

i-i 


1 dp ^ 1 duj 

y dx <-i Ui dx 


dy _ " y du, 
dx i-i Ui dx 


(35) 

(36) 


Since the last expression, with the u { cancelled out, must agree with that 
obtained by repeated use of equation (7), it must hold in this form even 
when some of the w< are zero or negative. 



Art. 67] 


TRIGONOMETRIC FUNCTIONS 


103 


For the sake of completeness, we note that since 

log x d 11 

logp x = :-> -r-(log p x) = ^- (37) 

log p dx log p x 

This is essentially equation (108) of section 48, which was our reason for 
introducing natural logarithms. 

67. Trigonometric and Inverse Trigonometric Functions. We showed 
in section 59 that 

d d 

— (sin x) = cos x, — (cos x) = —sin x. (38) 

dx dx 

It follows from their definitions in terms of the sine and cosine that: 

— (tan x) = sec 2 x, - 7 - (cot x) = —esc 2 x, (39) 

dx dx 

and 

d d 

— (sec x) = tan x sec x, — (esc x) = — cot x esc x. (40) 
dx dx 

For the principal branch of x = sin -1 y , as defined in section 60, 
— ir/2 < x < 7 t/2 , cos x is positive. Hence we have from section 64: 

4- (sin -1 y) = ~ = ~ 7 == = • (41) 


Interchanging x and y, we find 

— (sin x) = 77 = 


7T 

- < Sill X < ~ - 
A JL 


By similar reasoning, we find, for values of y in the first quadrant, 
0 < y < ir/ 2 , 


(cos 1 x) = 


Vl - X 2 ’ dx 


(sec 1 x) = 


(esc 1 x) 


These formulas may be modified to extend to all branches of the 
functions, by the use of 


— (sin 1 x) 
dx 


when cos y is negative, (44) 


(cos 1 x) 


when sin y is negative, (45) 
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■*> 

-1 

when tan y is negative, 

(46) 

1V1 2 — 1 

£(c*r‘*) 

1 

when cot y is negative. 

(47) 

x\/x 2 — 1 


In each case y is the value of the inverse function, and the earlier formulas 
(42) and (43), which have the opposite sign, are to be used whenever the 
functions of y explicitly mentioned in each case as negative are positive. 
To illustrate the necessity for care, consider the differentiation: 


, /1\ du —1 —1 1 

u — cos 1 (- 1, — = 7 ==== = • —5- = — ;. • 

W dx Vl- (1/x) 2 * xV x 2 - 1 


(48) 


The sign used in the differentiation must be changed if sin u is negative, 
and the multiplying in of x, or use of x = Vx 2 , is correct if x is positive, 
and requires an additional change of sign if x is negative. As x — sec u, 
the result as given is correct if sin u and sec u have the same sign, that is 
when tan u is positive. Otherwise the sign should be changed. This is 
in accord with equation (46), since u — cos -1 (1/x) = sec -1 x. 

68. Hyperbolic Functions and their Inverse Functions. The hyper¬ 
bolic sine and cosine are defined in terms of the exponential functions: 


sinh x = 



and 


cosh x — 


e l±H 

2 


(49) 


The other four hyperbolic functions are defined by equations analogous 
to those for the trigonometric functions: 


, , smh x 

tanb x = —:—> 
cosh x 

1 


sech x = 


cosh x 
coth x — ——» 
smh x 

1 


cosh x 


csch x 


sinh x 


(50) 

(51) 


The properties of these functions may all be deduced from these equar- 
tions and from the properties of the exponential function. 

In particular: 

cosh 2 x — sinh 2 x - 1, (52) 

and 

coth 2 x — csch 2 z=l, tanh 2 x + sech 2 x = 1. (53) 

Recalling equation (28), we find: 

£ <2 

, ,, . — (sinh x) - cosh x, — (cosh x) « sinh x. 
ax ax 


(54) 
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By using equation (8), and the equations of this section, we find: 
d d 

— (tanh x ) = sech 2 x, — (coth x) = — csch 2 x, (55) 
ax ax 

d d 

— (sech x) = —tanh x sech x , — (csch x) = —coth x csch x. (56) 
dx ax 


It may be seen from equations (49) that cosh x is always positive, 
while sinh x is positive for positive x and negative for negative x. 
Also that: 

sinh (— x) = —sinh x and cosh (— x) = cosh x. (57) 


While a simple method of systematically obtaining identities in hyper¬ 
bolic functions from the corresponding ones in trigonometric functions 
will be given in section 106, we note here that the addition theorems are: 

sinh (a + b) = sinh a cosh b + cosh a sinh ft, (58) 

cosh (a + b) = cosh a cosh b + sinh a sinh b . (59) 


They may be verified by using equation (49) to reduce each side to a 
combination of exponentials. The subtraction theorems may be found 
by replacing b by —b and using equations (57). We may then deduce 
that: 


and 


( h\ . h 

sinh (x + h) — sinh x = 2 cosh ( x + -) s^h g* 
cosh (x + h) — cosh x = 2 sinh ^x + sinh ^ 


(60) 

( 61 ) 


by a procedure analogous to that used for the corresponding trigono¬ 
metric equations. It follows from equation (60) that sinh x increases 
for all values of x, and from equation (61) that cosh x increases for all 
positive values of x. Thus we may define the inverse functions 
x = sinif 1 y , and x = cosh -1 y . The latter is only defined for y ^ 1, 
and has two branches, a positive and a negative branch. The increas¬ 
ing or decreasing character of the remaining functions may then be 
inferred from equations (51) and (53). Thus we may define tanh -1 y } 
coth -1 y and csch -1 y which have only one branch, and sech -1 y which 
has two branches, one positive and one negative. We may find the 
derivatives of these functions as we did for the inverse trigonometric 
functions. The results, with x and y interchanged, are: 


— (sinh 1 x) 


1 

VT+x 2 ’ 


dx 


(csch 1 x) 


-1 

|as|1 + x 3 


(62) 
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~ (tanh 1 x) 
ax 


dx 


(coth 1 x) 


1-x 2 


and, for the positive branch: 


— (cosh 1 x) 
dx 



— (sech 1 x) 
dx 



(63) 

(64) 


The signs must be reversed in these last two equations if we use the 
negative branch, that is the branch for which y and hence sinh y are 
negative. 

We observe that the inverse hyperbolic functions may be expressed 
in terms of logarithms by such formulas as 

i—i 1 1 1 + x 

tanh 1 x = ~ log --> (65) 

2 1 — x 

and 

sinh"" 1 x = log (x + Vx 2 + 1). (66) 

69. Elementary Functions. An elementary function Is one which 
can be explicitly represented in terms of constants and the independent 
variable by means of the four fundamental operations and the basic 
elementary functions discussed in Chapter III, using at most a finite 
number of operations and a finite number of basic functions. For 
example, the hyperbolic functions and their inverses are elementary 
functions. While it is convenient to use fundamental formulas involv¬ 
ing the power, x®, logarithms and exponential functions to any base, the 
six trigonometric functions and their inverses, as well as the six hyper¬ 
bolic functions and their inverses, we only need to take the functions 
e*, log x, sin x and sin"" 1 x as fundamental. For all the remaining func¬ 
tions can be expressed in terms of these, at least in a limited range of the 
variable. For example, we have: 

v u = e t,log, J v > 0, cos x = sin — x^ > (67) 

and, for suitable branches of the inverse functions: 

tan"" 1 x = sin"" 1 -7==— • (68) 

VI + X 2 

By using the principles of sections 63 and 65, in combination with the 
special formulas of sections 66 and 67, we may determine the derivative 
of any elementary function for all values of x in suitably restricted 
ranges. Whenever the calculation of the expression which represents 
the derivative for a particular value of x does not introduce the division 
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by, or taking of the logarithm of, an expression which reduces to zero 
for this value, or the even root, irrational power or logarithm of a nega¬ 
tive quantity, the expression gives the derivative. 

When the calculation does not lead to a definite result which is real 
and finite, the principles involved are no longer applicable. Frequently, 
the expression will fail to have a derivative for the excepted values of x. 
For example y = Vx for x = 0 or x negative. In some cases the func¬ 
tion will have a derivative, as we may show by a direct appeal to the 
definition. For example, if y = x 2 sin (1/x) and x ^ 0, the rules show 
that 

= 2x sin - — cos - • (69) 

dx xx 


If x = 0, this expression contains a vanishing denominator. Moreover, 
as x —■> 0, the expression oscillates. The function itself, x 2 sin (1 /x), 
defines no value directly when x = 0, since it contains a vanishing 
denominator. However, as x —> 0, it approaches 0, so that it is natural 
to define y = 0 when x — 0, since this is the only value that will make 
the function continuous at zero. If we do this, so that /(0) = 0, 
f(x) = x 2 sin (1/x), x 0, then 


/( q + &) - m 

h 


h 2 sin 7 ~ 0 
h 

h 


h 


. 1 
sm-j 
h 


(70) 


which approaches zero when h —► 0, since the sine factor is never numeri¬ 
cally greater than unity. Thus, the function f(x) has a derivative at 
zero, and /'(0) = 0. 

We note that, as defined in this section, the inverse of an elementary 
function is not necessarily an elementary function. An example is 
2/ = 2x + sin x. 

70. Differentials. Let the function y = f(x) have a derivative 
f(x) at the point x. Then the differential of the independent variable, 
dx, is any number, selected arbitrarily. It may be either fixed through¬ 
out the discussion, or dx itself may be regarded as an independent vari¬ 
able. The differential of the dependent variable, dy, is then defined by 
the equation 

dy « f(x) dx . (71) 

In particular, if y = x, f(x) = 1, so that 

dy = dx. (72) 

Thus the differential of a dependent variable equal to x is equal to the 
differential of the independent variable x. 
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Again, if a third variable t is taken as the independent variable, where 
x =* F(t) and y * G(t) have derivatives, we have in accordance with 
the equation (71), with x replaced by t, 

dx — F'(t) dt and dy = G'(t) dt. (73) 

But, by equation (15), 

I'll ” (74) 

In view of this equation, the equations (73) together lead to 
dy — f'(x) dx. Thus the relation (71) holds whether x, or some other 
variable t is the independent variable. 

Having defined differentials satisfying the relation 

dy ^ dx = f'(x) = —, (76) 

we may now think of this last notation as an actual fraction, and when 
du 9 ^ 0, regard equation (15) as equivalent to ordinary cancellation of 
common factors from a fraction. 

If we give x an increment, Ax, equal to the number selected for dx, 
we shall have: 



dx = Ax, dy = /'(x) Ax. 

(76) 

Again, if we put 

^=/'(x) + a, 

Ax 

(77) 

then 


/'(x) 

Ay 

*= lim — implies lim a ■» 0. 

Aar— AX 

(78) 

That is, 



A y *■ f'(x) Ax + a Ax, where a —► 0 as Ax —* 0. 

(79) 


This shows that dy and Ay differ by a term a Ax, so that, if we take a 
sequence of values Ax approaching zero, the difference between dy and 
Ay for these values will not only approach zero, but will approach zero 
even when divided by Ax. Hence, when Ax is sufficiently small, dy and 
Ay will differ by a small fraction of Ax. In precise form: 

For my positive quantity «, there is a 5„ such that if 

|Ax] < i„ then — - " — -" l < «. 


(80) 
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If the increment Ay, corresponding to an increment Ax, at the point x 
for a functional relation y — f(x) is such that for some A independent 
of Ax, 

y = A Ax + a Ax, where a —* 0 as Ax —»0, (81) 

the function fix) is said to be differentiable. From the relation (79) it 
follows that, if fix) has a derivative, the function is differentiable, with 
A = fix). 

Conversely, if a function is differentiable it has a derivative, since 
from the condition (81) we have: 

lim — = lim (A. + a) = A, (82) 

Ax —M3 AX Ax —►O 


so that/(x) has a derivative, and/(x) = A. 

71. Higher Derivatives. If we start with a function f(x ), we may 
obtain from it by differentiation the derived function f(x). We may 
now tokef(x) and apply the process of differentiation to it. The result 
is: 


[fix))' 


d d 

y ~ h m 

ax ax h-+o 


fix + h) - fix) 


(83) 


if the fraction on the right approaches a limit. This derivative of the 
derived function is called the second derivative, or derivative of the second 
order, and is indicated by 

fix) or ~, (84) 

a contraction for the first two expressions in equation (83). The func¬ 
tion f'ix) is called the second derived f unction. 

Similarly, we may repeat the process of differentiation n times, and so 
obtain the nth derivative, or nth derived function: 

f M ix) or (85) 

The derivative fix) is sometimes called the first derivative, when 
derivatives of different orders are under consideration. 

By restricting the increment h to be positive for each limiting process, 
we obtain right-hand derivatives of the nth order. Similarly, by 
restricting h to be negative, we obtain left-hand derivatives of the nth 
order. One application of these is to the higher derivatives of a function 
at the end points of a closed interval, outside of which the function is not 
defined. 
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If u = f(x) and y = g(u), as in section 65, we have 
y = glf(x)] = F(x), 

and from equation (15) 


( 86 ) 

(87) 


If we differentiate this by using equations (7) and (15), we find: 

d 2 V d2 y (du\ 2 dyd?u 

dx 2 du 2 \dx/ du dx 2 ’ ' 

or F"(x) = g" (u)[f' (x)] 2 + g'(u)f"(x). (89) 

By using this result we may find out how second differentials depend 
on our choice of independent variable. Let us indicate the independent 
variable by a subscript and define second differentials by the equations: 

(d 2 y) x = (0) (dx) 2 = F”(x) (dx) 2 , (90) 

and similarly 

(d 2 y) u = (^) (du) 2 = g"(u)(du) 2 , (91) 

and 

(d 2 u) x = (-0) (dx) 2 = f"(x) (dx) 2 . (92) 

Then, on multiplying equation (88) by (dx) 2 we find: 

(d 2 y) x = (d 2 y) u +(d 2 u) t f u . (93) 

Since the last term in this equation is 

g'(u)f"(x)(dx) 2 , (94) 

it will be zero only in exceptional cases. Thus the second differential of 
y when x is the independent variable given by equation (90) will usually 
differ from the second differential of y when u is the independent variable 
given by equation (91). 

While second, and higher, differentials may be introduced, since they 
depend on the choice of independent variable, and are of little help in 
making a chahge of independent variable, they have few of the advan¬ 
tages of the first differentials introduced in section 70. Consequently 
it is usually preferable to avoid them, regarding d n y/dx n not as an 
actual quotient of two differentials, but simply as a suggestive notation 
for n repetitions of the operation of differentiation, (d/dx) n y. 
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72. The Rule of Leibniz. The formula for the differentiation of a 
product may be extended to higher derivatives, and is known as the 
Leibniz rule. If we denote differentiation of the factors of a product 
involving u by D u , and of those involving v by D v , then we may write: 

Jj; (uv) = (D u + D v )uv = ^ v + u 7 (95) 

since this agrees with equation (7). Since the operators D u and D v com¬ 
bine like algebraic quantities, with respect to addition, multiplication, 
and multiplication by constants, it follows that: 

^ (uv) = (D u + D v ) n uv 

= (d: + nDT x D v + n( " ~ 1} d:~ 2 d 2 v + ••• + />:) uv 

d n u d n ~~ l u dv n(n — 1) d n ~ 2 u d 2 v (Tv 

~dx kV + Tl dx^ dx + 1-2 ~d^ 2 ~d? + * ’ ‘ + dx n ' 

(96) 

where the coefficients are the binomial coefficients. 

In particular, when the factor v is x r , or a polynomial in x of the rth 
degree, where r is an integer, the expansion will contain at most r + 1 
terms, since if n exceeds r, all the terms after the (r + l)st will contain 
a derivative of v of at least the (r + 1 )st order, and hence will vanish. 

A similar rule could be developed for the nth derivative of a product 
of any number of terms, 

(uiu 2 • • • u m ) = (Di + D 2 + • • • + D m ) n uiu 2 * • • u m . (97) 

Here Dk denotes the differentiation of those factors of a product which 
involve Uk, and the product on the right may be expanded by the 
multinomial theorem. 

73. Rolle’s Theorem. This theorem states that: 

If f(x) has a derivative, finite or infinite, at all the points of an open inter¬ 
val, a < x <b, and if 

lim f(x) = 0 and lim f(x) = 0, (98) 

x —►a-f* x—►b— 

then at some point £ of the open interval, a < £ < b, the derivative is zero , 

/'«) = o. 

To prove this theorem, we define a function in the closed interval 
a g x g b, by putting 

F(x) « f(x), a < x < b; F(a) « 0, F(b) = 0. 


(99) 
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This function is continuous, in view of the condition (98), throughout 
the closed interval. Hence, by section 33, there is a point of the closed 
interval a,b at which the function actually takes on its maximum value, 
and a point at which the function takes on its minimum value. If both 
these points were end points, the function Fix), having its ma xi mum 
and minimum values each equal to zero, would be zero throughout. 

Hence/(x) would be zero in the open interval, and 
f'(x) would be zero at all points of this interval, 
so that we could take any point of the interval as 
the point £ of the theorem. 

Suppose then that one of the two points men¬ 
tioned, say the maximum, is an interior point. If this point is £, from 
the nature of a maximum, we have: 

P(£) ^ F{x), or /(£) £ f(x). (100) 



o { b 

Fig. 9. 


Hence, for the derivative at £, we have: 


mid also 


/(£) = lim IQ ^ o 

h-^OA- h 


At) - lim MLtllxM s 0. 

A-M)- h 


( 101 ) 

( 102 ) 


Thus we must have f'(£) — 0, and the theorem is proved. 

If the minimum is taken on at an interior point, the maximum being 
only reached at an end point, we may prove the theorem in a similar 
manner. Or we may consider — /(x). 

We call attention to the fact that the theorem does not require the 
function/(x) to be differentiable, or even to be defined, at the end points 
a and b. If it is differentiable at these points, it will be continuous at 
a and b. In this case, or whenever the function is continuous at a and b, 
we may replace the condition (98) by the requirement 

/(a) = f( b ) = 0. (103) 

In any case, the theorem shows that we may always take the point £ 
as an interior point of the interval. 

74. Hie Mean Value Theorem. This theorem is the analytic expres¬ 
sion of the fact that on any smooth arc of a curve joining the points P 
and Q, there is at least one intermediate point T, such that the tangent 
to the curve at T is parallel to the chord joining P and Q. 

If the curve is the graph of a single-valued function, y = /(x), it will 
be smooth if the function is differentiable. If the end points of the arc 
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are P = [a,/(a)] and Q — [b,f(b)], the slope of the chord will be 
• As the slope of the tangent to the curve at any point x 

will be /'(%), the analytic formulation of the theorem is: 

If f(x) has a derivative, finite or infinite , at all points of an open interval 
a < x < b, and is continuous at the end points of {and hence throughout) 
the closed interval a :g x :§ b, then at some point 
£ of the open interval , a < £ <b, 

(104) 

We prove this theorem by applying Rolle’s 

theorem to a function whose form is suggested ___ _ __ ^ 

by geometric considerations. If an ordinate at 0 ® 1 * * 

x meets the chord PQ in R and the curve in S, the p IG 10 

part of the ordinate measured from R to S is: 

tt»/„\ i»/„\ ri*/~\ i f(b) -f(a) , _ 


F(x) = f(x) - f(a ) + 


Since /(x) is continuous in the closed interval a,b and has a finite or 
infinite derivative at all points of the open interval a, b, the function 
F(x) also has these properties. Moreover, a direct calculation shows 
that 

F(a) - F(b) = 0. (106) 


Hence F(x) satisfies all the conditions of Rollers theorem, and there is 
a point £ in the open interval a < x < b at which 

f ' h ) = /'(*) - /(6 • ~ /(a) - o, (107) 

o — a 


which is equivalent to the equation (104). 

Since twice the area of the triangle PQS equals (b — a) RS , we might 
have proved the theorem by applying Rollers theorem to this doubled 
area, which in determinant form is: 

✓p j^) | 

a f(a) 1 -2A(*) - (b - a) F(x). (108) 

b f(b ) 1 

It follows from Rolle’s theorem that: 

i fit) o 

o fia) 1 = 2A'({) = 0, 

b /(b) 1 


( 109 ) 
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which is equivalent to equation (104). The vanishing for * = a and 
* = b is seen from the fact that for these values the determinant in 
equation (108) has two rows identical. In differentiating the determi¬ 
nant, we may either consider the expansion or use the result of problem 6 
of Exercises IV. 

If we put 6 = a + h, we may write £ = a + Oh, where 


O<0<1. (110) 

We shall frequently use the symbol 0 for a suitably chosen number satis¬ 
fying this restriction. With this notation, the conclusion of the mean 
value theorem may be written 


or 


/(a + h) — /(a) 
h 


— f'( a + 9h), 


( 111 ) 


f(a + h) - /(a) + hf\a + Oh). (112) 


Since the left member of equation (104) is unchanged if we inter¬ 
change a and b, the equation is equally true if a > b, the condition here 
holding in the interval b,a. Thus we may take h negative, as well as 
positive, in the equations (111) and (112). 

Either of the results (104) and (111) is sometimes called the Law of 
the Mean for the differential calculus. The term Law of finite increments 
is also used for equation (112), or its equivalents - 


fib) -fia) = ib — a)fit) 

(113) 

fib) =fia) + ib-a)fii). 

(114) 


As a particular result of equation (111), we note that for a finite h 
the difference quotient, whose limit as h —> 0 is the derivative at a, is 
equal to the value of the derivative at a + Oh, a suitably chosen point 
between a and a + h. 

75. Increasing Functions. In any interval throughout which 
fix) > 0, the function/(a;) is increasing. For, if x 1 and x% are any two 
points in such an interval, we see from the law of finite increments that 

/(*»)-/(*!) - (*a-x,)/'(£). (115) 

Thus, since /'(£) > 0, the differences f(x 2 ) — f(xi) and xt — xi neces¬ 
sarily have the same algebraic sign, and 

fix*) > fix j) if * 2 > X\. (116) 

As the statement that there is a derivative implies that the function is 
continuous, if fix) has a positive derivative throughout an interval, 
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y « fix) is a continuous increasing function in this interval, and there 
is an inverse function x = f~ x (y). Hence the discussion of section 64 
is applicable, and in particular the equation (13) holds. 

A similar argument may be used if fix) has a negative derivative 
throughout an interval. 

Whenever/'(x) is continuous at x 0 , and not zero there, there is some 
interval including x 0 in which fix) preserves its sign, so that the equation 
(13) may be used at any point where the derivative is continuous and 
different from zero. 

If fix) is zero throughout an interval , the function fix) must he constant 
in that interval . For in this case, for a particular value a in the interval, 
and any x, we have: 

fix) -/(a) = ix - a) fit) = 0. (117) 

This shows that for all points x in the interval the function fix) = f (a), 
and so has a constant value. 

Let us next suppose that the function fix) has a derivative/'(x) > 0 
for all points of an interval a ,b with the exception of a finite number of 
points Then these points pi will divide the interval a ,b into a set 
of subintervals. In the open interval corresponding to any one of these 
subintervals, the function fix) will be increasing. We may use the closed 
intervals if the function fix) is continuous at the points p^ Thus, if 
the function is continuous at the points p,-, and hence throughout the 
interval a,6, it will be increasing in the interval a, h. The same argument 
applies if fix) > 0 for all values of x, all greater than a, or all less than 
6, except for a set of points pi at which fix) is continuous. Here the p» 
may be infinite in number so long as they are isolated, that is, have no 
limit point. 

If we merely know that fix) 0 throughout an interval, we can 
only conclude from the equation (115) that 

fix 2 ) ^ fix i) if x 2 > x u (118) 

so that while the function is monotonic, it is not necessarily actually 
increasing. 

While we may draw conclusions as to the behavior of a function from 
any restriction as to the sign of the derivative which holds throughout 
an interval, similar conclusions can not be drawn from such information 
at a single point. As an example, consider the function y ~ fix), 

where fix) * x + 2x 2 sin*~> x ^ 0, and /(0) « 0. 

x 


( 119 ) 
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This has a derivative +1 at the origin, obtained by a direct application 
of the definition or from equation (70). But, for values near zero 
though different from it we have: 

f (x) = 1 + 4x sin * — 2 cos - > (120) 

X X 

which is negative in some points of every interval which has point x » 0 
as an interior or end point. 

Thus, although the derivative is positive at x = 0, the function is not 
monotonic in any interval including 0. This follows from the fact, a 
direct consequence of the definition of a derivative, that if /(x) is mono- 
tonieally increasing throughout an interval, the derivative fix) cannot 
be negative at any point of the interval. 

76. Relative Maxima and Minima. The term maximum, as used in 
section 33, referred to the absolute maximum (maximum maximorum) 
for the interval considered. A point at which the value of a function is 
greater than or equal to all values considered in the immediate neighbor¬ 
hood of the point, that is, in a sufficiently small interval having the 
point in its interior, is a relative maximum. Thus a relative maximum 
for the original interval is an absolute maximum for some sufficiently 
small subinterval. At the end points of a closed interval a,b we only 
consider values on one side. 

If f(x) is considered for the interval a < x < b, and £ is an interior 
point of this interval at which fix) has a relative maximum, and at which 
/(x) has a derivative, f (£), then we may argue as in section 73 and deduce 
from equations (101) and (102) that /'(£) = 0. Similar reasoning 
applies to the relative minima. This proves that: 

The relative maxima and minima of a function f(x) for the closed 
interval a % x s£ b can only occur at the end points a and b, at points 
where fix) fcdls to have a derivative, finite or infinite, or at points where 
fix) - 0. 

In the examples treated in elementary calculus, the functions usually 
had derivatives at all the points considered. Either there were no end 
points, as when we considered a polynomial for all values of x, or the 
values taken on at the end points were not the maxima or minima 
wanted. Thus the desired points corresponded to fix) « 0. 

Even in simple algebraic cases we sometimes need to consider the 
points where there is no derivative. Thus, if y * x 2/3 , —lj&x£l, 
the minimum occurs at the point x ** 0, and is zero. There is no deriva¬ 
tive at this point, since the right-hand derivative is + «o, while the left- 
hand derivative is — m . 
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A sufficient condition for a relative maximum is given by: 

A point c, at which f(x) is continuous, and such that fix) > 0 for some 
interval c — h < x < c while fix) < 0 for some interval c < x < c + k, 
is a relative maximum. 


This statement follows from the preceding section, since as x increases 
through c,f(x) increases to/(c) and then decreases. 

Similarly: 

A point c, at which fix) is continuous, and such that f (x) < 0 for some 
interval c — h < x < c while f (x) > 0 for some interval c < x < c + k, 
is a relative minimum. 

For functions with continuous derivatives, in these cases, /'(c) = 0. 
A less general test, in terms of higher derivatives, is given in problem 42, 
Exercises IV. 

77. Intermediate Values of the Derivative. A function may be 
continuous at a point without having a derivative at the point. An 
example is y = f(x), where 

f(x) = x sin -> i^O, /(0) = 0, (121) 

x 

which is continuous at x — 0, but has no derivative there, since the 
difference quotient sin (1/A) oscillates between 1 and —1 as h—+ 0. 
In problem 10, Exercises IV, a function is given with no derivative at 
any point of an interval, throughout which it is continuous. 

Even if a function has a derivative at all points of an interval, the 
derivative need not be continuous at all points of the interval. Thus 
the function defined by equation (119) has a derivative for all values 
of x, but this derivative is not continuous at x = 0. Nevertheless, the 
derived function has in common with continuous functions the inter¬ 
mediate value property we proved in section 34. Specifically: 

If f{x) has a derivative fix), finite or infinite, at all points of a closed 
interval a x 2s b, then f'(x) takes on every value between f (a) and 
fib) at some point of the interval between a and b. 

Suppose, for definiteness, that/ 7 (a) < fib), so that the intermediate 
value in question, k, satisfies: 

fia) <k <?{b). (122) 

Then, from the definition of a derivative as a limit, we can find a pom- 
tive number h such that: 


fia + h) -fia) 


< k and 


fib - h)-m 


>k. 


(123) 
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Thus the function 

h 


(124) 


is < k at x = a, and > k at x = b — h, so that k is an intermediate value 
of this function for the interval a x ^ b — h. But, as fix) has a 
derivative throughout this interval, it is continuous in the closed inter¬ 
val, and the same is true of Fix). Hence, by the intermediate value 
property of continuous functions, there is a point x 0 such that 



a < x 0 < b — h } 

(125) 

for which 




Fix 0 ) = /(*o + fc)-/(*o) = k 
h 

(126) 

But, by the 

mean value theorem, 



fix 0 + h) - fix 0 ) ^ 
h 

(127) 

where 

x 0 < $ < x 0 + h. 

(128) 

From the relations (125) and (128) we see that 



a < £ < b, 

(129) 

while from the 

equations (126) and (127) we have 



fit) = k, 

(130) 


so that we have proved the theorem. 

78. Limiting Values of the Derived Function. A function may have 
a derivative at a even though the derived function f'(x) approaches no 
limit as x —* a. The function defined by equation (119) is an example 
of this, with a = 0. However, we may show that: 

If the derived function f (x) approaches a limit as x—> o+, 

lim f(x) = L, (131) 

then, if fix) is suitably defined at x — a, the function fix) will have a right- 
hand derivative atx*=a. 

We observe that the equation (131) implies that there is some open 
interval, a < x < a + hi, in which the function fix) has a derivative. 
Consequently, we may apply the law of finite increments to obtain: 

fix*)-fix. 0 = ix 2 - Xl )/((), (132) 

where %\ and *2 are any two points of the open interval a,a + hi, and 
f is a suitably determined value between x\ and x 2 . 
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Again, the condition (131) implies that we may find a d x such that if 
a < x < a + Si, 


l/'(x) - 

- L\ < c < 1, so that \f(x)\ < \L\ + 1. 

(133) 

Thus, if X\ and x 2 

are each in the interval 



a < x < a + 

(134) 

where 

8 t < 5i and also 5 e < > 

m +1 

(135) 

we shall have 



\fix 2 ) -fiXl )I <€. 

(136) 


Since this relation holds for arbitrarily small values of e, when x x and 
x 2 are each in the interval (134), the Cauchy convergence criterion is 
satisfied, and f(x) approaches a limit when x —* a+. Hence we may 
define 

f(a) = lim f(x). (137) 

x —►a-f 

With this definition of /(a), and any positive h less than hi, the func¬ 
tion/(x) is continuous in the closed interval a,a + h and we may deduce 
from the mean value theorem that: 


f(a + h) 
h 


f(a + 6h), 0 < 0 < 1. 


It follows from this and equation (131) that 


lira 

A-.0+ 


fia + h) - m 
h 


= L, 


(139) 


which proves that the function has a right-hand derivative at a equal 
to L. 

If 

/(a) = lim f(x), and lim }'{x) = +», (140) 

x—►a-f 


we may deduce from the second part of this argument that fix) has a 
right-hand derivative at a equal to + ». An example is Vx, with 
o = 0. 

However, we cannot conclude from the second part of equation (140) 
that the first part defines f(a) as a finite limit. For example, if fix) «* 
— 1/x, as x —* 0-h fix) —* + oo, but fix) —» — », so that we cannot 
define/(0) by equation (137). 
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In connection with this example, we prove that 
If , for any finite value a, |/(x)| —> go asx —> a, thenf (x) cannot approach 
a finite limit as x~~*a. 

In fact, if f(x) approached a finite limit, it would be bounded in some 
open interval a,a + h , and for any two values x and x x each in this open 
interval we should have: 

/(*)-/(*0 « (141) 

But, from this in combination with 

[/'(£)! < M, and \x - x x \ < h, (142) 

we may deduce that 

!/(*)-/(*i)l <Mh. (143) 


This shows that, if x x is fixed and a, f(x) remains bounded, which 
contradicts the hypothesis that |/(x)] —> oo. 

Note that this result need not hold if x —» + go , instead of a finite 
value a. For example if f(x) = x, as a;—> + <», jf(x)—> + «>, but 
f'(x) 1. Also,if f(x) = Vx, as x —> + oo,/(x) *-> + «, but/'(x) —* 0. 

79. A Generalized Mean Value Theorem. Let us recall the geometric 
situation described at the beginning of section 74. Let us express the 

coordinates of any point S on the arc PQ in 
terms of a parameter t, so that x = G(t), 
and y = F(t) where the points of the arc 
correspond to the values of t, a £ t 5* b. 
With this notation, the slope of the chord 
is [F(b) ~ F(a)]/[G(b) - G(a)] t while the 
slope of the curve at the point T corre¬ 
sponding to t = r, is F r (r)/G f (r) t This 
suggests the equation (145) below, and 
hence the theorem: 



\G$m 

Fig. 11. 


a) If F(t) and G(t) each has a finite derivative at all the points of an 
open interval a < t < 6, and are continuous at the end points (and hence 
throughout) the closed interval a £ t & b, then at some point r of the open 
interval , a < r < b, 


[F(b) - F(a )] G'(r) - [G(b) - G(a)] F'(r). (144) 

b) If, in addition, G(a) 9 * (7(6), and F f (t) and G f (t) are never both 
zero for the same value of t in the open interval , then 

F(b) - F(a) F'(r) 

G(b) G(a) * G'(r)* 


( 145 ) 
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We prove part (a) of the theorem by applying Rolled theorem to the 
doubled area of the triangle PQS. With the present notation this is 


G(t) 

Fit) 

1 



G(a) 

F(a) 

1 

= 2 Ait). 

(146) 

G(b ) 

Fib ) 

1 




Thus there is a r for which: 


G\r) 

F'ir) 

0 



Gia) 

Fia) 

1 

= 2 A'ir) = 0, 

(147) 

Gib) 

Fib) 

1 




which is equivalent to equation (144). 

Let us now assume that the additional hypotheses of part (b) hold. 
Then, if F'(t ) = 0, it follows that G'(r) ^ 0. On the other hand, if 
F'(r) 0, since G(b) — G (a) 5 ^ 0, the right member of equation (144) 

is not zero. Therefore the left member is not zero, and again G'(t) 0 . 

Thus we may divide by G f (r) and [G(b) — G(a)] and so deduce equation 
(145). 

We may replace the additional conditions (b) by: 

c) If G f (t) is never zero throughout the open interval a,b the additional 
hypotheses (b) necessarily hold , so that equation (145) follows. 

For, if Q'(t) 7 * 0, F'(t) and G'(t) can never both vanish for the same t. 
And, from the law of finite increments, 

0(b) - G(a ) = (b - a) G'(£) ^ 0. (148) 


80. L’Hospital’s Rule for the Indeterminate Form 0/0. If, when 
x a, f(x) 0 and g(x) —» 0, the quotient f(x)/g(x) may approach a 
limit as x approaches a. As we remarked in section 21, whether this 
limit exists, and its value if it exists, cannot be predicted without further 
information about the functions. The situation is briefly described as 
an indeterminate form 0/0. 

For a continuous function f(x) } when h —► 0, f(x + h) - /(a;)-*0, 
so that [f(x + h) — f(x))/h is an indeterminate form 0/0 for h =» 0, 
Thus every time we calculate a derivative we are evaluating a limit of the 
type now under consideration. 

In some cases, where the indeterminate form approaches a limit, the 
value of the limit may be found by THospitaPs rule, which states that: 

If f(x) 0 and g(x) 0 as x a+, 


*-*<•+ 9 {%) 


L, 


and 


(149) 
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then 


lim 


fix) 


»-*<»+ g(x) 


- L. 


(150) 


7n place 0 / the finite limit L on the right of equations (149) and (150), we 
may have + *> or — oo. 

Also, instead of taking all four limits in the theorem as x —> a+, we may 
take them all as x a~, or simply as x —►a. 

This form of the rule is a consequence of the generalized mean value 
theorem. We note first that, from the condition (149), there must be 
some open interval a < x < a + h throughout which the functions 
f(x) and g(x) each have finite derivatives, and in which g'(x) 0. 

Let us define 


F(x) = /(x) and G(x) = g(x) for a < x < a + h } (151) 
and F(a ) = 0 and 6 (a) = 0. (152) 

Then the functions F(t) and G(t) will satisfy all the original conditions 
of the generalized mean value theorem, as well as the additional hypothe¬ 
sis (c), in any closed interval a g t g x, where x is any value in the 
open interval a < x < a + h. 

Thus, for some value, say x 0 , in the open interval 

a < x 0 < x, 

we shall have, by equation (145): 

f(x) = F(x) - F(a) _ F\zo) = 
g(x) G(x)-G(a) G'(x 0 ) g'(x 0 ) * 

It follows from the relation (153) that to any sequence of values of x 
approaching a+, there corresponds a sequence of values of x 0 approach¬ 
ing a+. But, since the relation (149) holds, the limit of f , (xo)/g'(xo) 
will be L, and hence, from equation (154), the limit of f(x)/g(x) for the 
first sequence will be L. Since this is true for any sequence, the con¬ 
clusion of the theorem, equation (150), follows. 

Since all sequences x may correspond to a special set of sequences x 0 , 
it is possible iorf(x)/g(x) to approach a limit, while f'(x)/g'(%) does not. 
The rule does not permit us to draw any conclusion from the failure of 
g , (x)/f(x) to approach a limit. 

From lim f (x)/g\x) = + <*>, we may deduce that lim f(x)/g(x) 

X—►<!-+• x—►O'f' 

« +<», and similarly for — w. Also, from lim \f'(x)/g'(x)\ = », 

x—*-a+ 

we may deduce that lim \f(x)/g(x)\ = <», since in this case 


(153) 

(154) 
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The argument as given for x —> a+ requires only slight modification 
to apply to x —* a—, or to x —> a. 

81. Infinitesimals. We define the term infinitesimal to mean any 
variable whose limit is zero. Thus, if x is approaching a, h *= x — a is an 
infinitesimal. We may think of any function of x which is infinitesimal 
as x approaches a as a function of this infinitesimal h. For example, 

y = fix) - f(a) = /(a + A) - /(a). (156) 


The particular infinitesimal in terms of which we express all the infinitesi¬ 
mals in a given limiting process is called the principal infinitesimal. 

The principal infinitesimal is said to be of the first order. If h is the 
principal infinitesimal, and k is any other infinitesimal such that k/h 
approaches a finite limit distinct from zero; then k is also said to be of 
the first order. Similarly A n , where n is any positive integer, or any 
infinitesimal k such that the limit of k/h n is finite and different from 
zero, is said to be of the nth order. 

If ki is an infinitesimal of order m, and k 2 an infinitesimal of order n, 
then the limit of ki/k 2 will be finite and different from zero if m = n, 
and will be zero if m > n, since: 


k x fr h n u 

k 2 h m k 2 


(157) 


By analogy, we say that any two infinitesimals fci and k 2 have the same 
order if the limit of k\/k 2 is finite and different from zero, and that 
k\ is of higher order than k 2l or k 2 is of lower order than fcj, if the limit of 
k\/k 2 is zero. 

We do not attempt to define non-integral orders. Thus we assign no 
order to A 3/2 , although we can say that it is of higher order than h and of 
lower order than h 2 . Again, the infinitesimal h 2 sin (1/A) is of higher 
order than A, but not of lower order than A 3 or than A n with n any greater 
integer, since 


A 3 


h n 


A 2 sin 


or 


A 2 sin ■ 


(158) 


each fails to approach the limit zero. In fact each is undefined when 
1/A is an integral multiple of tt; but for suitable sequences of values of A 
which approach 0, the upper limit is + oo and the lower limit is — ». 
Again, the infinitesimals 



A sin 


y/2 

A 


(159) 
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are not of Hie same order, and neither is of higher order than the other. 
Our definitions thus serve to classify some but not all infinitesimals. 

While the order assigned depends on the principal infinitesimal, it is 
unchanged if we replace ft by any infinitesimal of the first order with 
respect to ft. A relation of the form “ h is of higher order than k 2 ” is 
independent of the choice of principal infinitesimal. 

We write 

h = o(k 2 ), (160) 

read “ ki is small o of k 2l ” if the limit of h/k 2 is zero. Thus, for any 
infinitesimal, k, we have k = o( 1 ), and, conversely, this implies that k 
is an infinitesimal. If h and k 2 are both infinitesimal, then the equation 
(160) indicates that the infinitesimal fci is of higher order than k 2 . For 
example, 

A* = o(h) and ft 2 sin 7 = o(hF). (161) 

ft 

For an infinitesimal k of the nth order, 
k k — Ah n 

since— -*A, — -> 0 , (162) 

and we may write: 

k = Ah n + o(h”). (163) 

Whenever k may be expressed in this form, with .4 ^ 0 , the term Ah n is 
called the principal part of the infinitesimal k. The discussion of 
section 70 shows that, if /'(a) 5 * 0 and Ax is the principal infinitesimal, 
then Ay is an infinitesimal of the first order, with f'(a) Ax, or the 
differential dy, as its principal part. 

It follows from the definition and section 19 that if 



Si = o(fci) and s 2 = o(k 2 ), 

(164) 

then 8182 

= o(kik 2 ). We abbreviate this result by writing 



o(fci) o(ft 2 ) = o(kik 2 ). 

(166) 

We interpret and prove 



0 (h) + o{k 2 ) = o(h + k 2 ) 

(166) 

similarly. 

In particular, 

Ao(h n ) - o(ft") and o(ft”) o(ft”) - o(h n+n ). 

(167) 

Also, 
if tn 2 s n, 

o(h n ) + o(h m ) * o(ft”). 

(108) 
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We may use these relations to prove that, if m > n and fci has a princi¬ 
pal part Aih m , and h has a principal part A 2 h n , then hh has a principal 
part AiA 2 h m+n , and ki + fc 2 has a principal part A 2 h n . 

We shall occasionally use a notation somewhat similar to equation 
(160), and write 

h = 0(h), (169) 

read “ ki is large 0 of k 2 ,” if there is some constant y such that 

\h\ ^ y\k 2 \, (170) 

beyond some stage of the limit process. Thus the relation (160) implies 
the relation (169), and in fact if ki/k 2 approaches a finite limit, or even 
if ki/k 2 has a finite upper limit the relation (169) holds. However the 
relation (170) also holds in other cases. For example, 



Among the rules of operation for this symbol, we mention 

0(h) 0(k 2 ) = 0(hk 2 ), AO(h) = 0(h), (172) 

0 (h) + 0 (k 2 ) = 0 (\h\ + |fc 2 |), 

and if h = 0(h), 0(h) + 0 (h) = 0(h)■ (173) 

82. Taylor’s Theorem for Infinitesimal Increments. Let us con¬ 
sider a function f(x), for values of x near a. As x—* a, h — x — a is an 
infinitesimal. If it is possible to find a polynomial of the nth degree in h, 

P(h) = A 0 + Aih + A 2 h 2 + • • • + A n h n , (174) 

such that 

f(x) = f(a + h) = P(h) + o(h n ), (176) 

then P(h) is called a Taylor’s development of the function/(x) about the 
point a, of the nth order. We say that P(h) approximates f(a -f h) to 
within terms of higher order than h n . 

We shall show that if the function/(x) has an (n + l)st derivative at 
the point a, / (n+1) (a), then it has a unique development of this type. 
As we need to know the values of the coefficients to carry out the proof, 
we shall begin by assuming that the function has a development of the 
form (175), and also that there is a derivative / <n+1) (o), and try to 
determine what the coefficients must be under these conditions. 

Since/ (B+1) (a) exists, / (n> (x) must exist throughout some closed inter¬ 
val x — fc g a g x + A:, and be continuous at a. Also, (x) and 
all the derivatives of lower order, as well as/(x) itself, must exist and 
be continuous throughout this same closed interval. 
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The relation (175) implies that 




(176) 


h-f o 

Since the denominator approaches zero, the numerator must also, and 
• lhn [/(a + h) - P(h )] = /(a) - A 0 = 0. (177) 

A—♦O 

Thus the left member of equation (176) satisfies the first condition of 
l’Hospital’8 rule, and if 

/'(« + h) - P'(h) 


lim' 

h-tO 


nh 


n-X 


exists, it must be 0. But the limit of the numerator is 

/'(a) - ^x (179) 

which would make the limit (178) + <© or — «, and hence contradict the 
equation (176), unless 

/(a) — Ai - 0. (180) 

In this case, we may apply l’Hospital’s rule to the expression (178), 
and by the same argument deduce that: 

lim [/"(a + h) - P”(h)] = /"(a) - 2 ! A 2 = 0. (181) 

A—*0 

A repetition of this argument shows that 

f (f) (a) = i ! Ai, or , for i — 1, 2, • • •, n. (182) 

l ! 


Let us now consider any function f(x), for which/ (B+1) (o) exists and 
is finite. We form the polynomial P(h), defined by the equations 
(174) and (182). Now consider 


lim 

h~*0 


/(q + h) - P(/Q 
h n+1 


(183) 


In view of the fact that P(0) = A 0 - f(a), we may apply l’Hospital's 


rule if the limit of 

/'(q + ft) - P'(h) 
(n + l)k n 


(184) 


exists. T&en, from the fact that P'( 0) = A\ = f (a), we may apply 
the rule again, if the limit of 

Aa + h) - P" W 

(n + l)nh n ~ l 


( 185 ) 
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exists, and so on, until after n applications of the rule, we come to 

/ w (q + h) - P w (h) = 1 f n) (a + h) 

(n + 1) ! h (n + 1) ! h ' { ' 

But, from the definition of the (n + l)st derivative, the limit of the 
difference quotient just written as h—>0 is Thus we may 

justify each application of l’Hospital’s rule in turn by working back¬ 
wards, and so find that 

f (a + h )-P( h ) i 


(» + 1) 


This proves that 


/(a + h) - P(h) = 0(/i n+1 ), and hence = o(h n ). (188) 

We express our results in the following theorem: 

If the function f (x) has a finite derivative / (n+1) (a) for x — a, then the 
polynomial in the infinitesimal h = x —• a, 


P(h) = f(a) + /'(a) — + f"(a) — + 


+ / (n) (a)— (189) 

n ! 


differs from f (a + h) by an infinitesimal of higher order than h n y so that: 

f(a + h) - P(h) + o(h n ). (190) 

There is no other polynomial of degree at most n which has this property . 
The behavior of f (a + h) — P(h) is given more precisely by equation (187), 

If the phrase/ (n+1) (a) = + 00 means that f {n) {x) has its (n + l)st 
derivative + <*> for x = a, then the preceding argument proves that: 

f(a + h)-P(h) A 

hm-—- = 0, (191) 

h-+o h 

so that the relation (190) still holds, but equation (187) must be replaced 
by 

f(a+h)-P(h) , _ 

lim- rz+i -= + 00 • (192) 

WO rl 


Similar conclusions can be drawn if/ (n+1) (a) = -<*>. 

It is to be noted, however, that we may have lim / (n+1) (x) = + <*> 

z—**a 

without hav ing / (n+1) (a) — + », in the above sense. We illustrated 
this for the first derivative in connection with equation (140). 
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83. Taylor’s Developments. The rules for operating with the sym¬ 
bols o(h n ) and 0(h n ) given in section 81 show that Taylor’s develop¬ 
ments may be combined like polynomials in many respects. For 
example, let us start with 

sin x » * — — + 0(x 4 ), (193) 

cosx=l-|^ + |^ + 0(x 6 ), (194) 

e* = 1 + x + j-y + J\ + 0(x 4 ), (195) 


(1 + x) m = 1 + mx + 


m(m — 1) 2 , m ( m ~ 1 )(m — 2) 

* + 37 

+ 0(x 4 ), 


(196) 

which may be derived from the equation (189) by direct differentiation. 
Then, operating as we would for polynomials, we may deduce: 


sin 2 x * x 2 — + 0(;z 6 ), sin 3 x = z* — + 0(x 7 ), (197) 

JL 


X 4 . X 6 


e**= l+x 2 +- + - + 0(x 8 ), 

cos (sin x) = 1 - ~ + 0(x 6 ), 

_ „ mx 2 , m(3m — 2) , , « 

cos” x = 1 -— H-—-- X 4 + 0(x 6 ). 

2 24 


(198) 

(199) 

( 200 ) 


Here we obtain (197) by multiplying the expansion (193) by itself, 
and then by itself again. Replacing x by x 2 in the expansion (195) 
gives the expansion (198). Replacing x in the expansion (194) by the 
terms of the expansion (193) gives the expansion (199). Replacing x 
in the expansion (196) by the terms following the 1 in the expansion 
(194) gives the expansion (200). 

For quotients, the special case of (196) with m — — 1, 

- 4 — = 1 - x + x 2 - x 3 + 0(x 4 ), (201) 

1 + X 

may often be used to advantage. Thus we find from it and (194) 

sec x * —— = l + ^~+^r x 4 + 0(x fl ). 
cos x 2 24 


(202) 
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This may also be found by long division, and checks with (200), if 


m = —1 there. Multiplication of (193) and (202) gives 

1 

tan x — sin x -= x + — + 0(x 6 ). (203) 

cos x 3 

Again, to find the development for sin -1 x, we may put 

v a 

y — sin 1 x, so that x - siny = y — — + 0(y s ). (204) 

O I 

We find from this, since x and y are of the same order, 

V = * + ~ + 0(x 5 ), y 3 = x 3 + 0(x 5 ), (205) 

and y = x + ^ + 0(x 5 ). (206) 

This may also be obtained by noting that if /(x) = sin"” 1 (x), then 

F(x) = /'(*) = = 1 + j + 0(x 4 ), (207) 


by putting —1/2 for m and — x 2 for x in (196). But, if a p x p is a typical 
term of the expansion of f(x), and A p x p a term of the expansion of 
F(x), = fix), we have: 

oq = /(0) and for p > 0, 


/ <P) (Q) _ 0) _ A p _! 

pi (p - l) \p p 


(208) 


This relation enables us to derive (206) from (207). 

In general, if we are expanding a function g(x) in powers of the 
infinitesimal h = x — a, the expansion will start with g(a), so that the 
infinitesimal k = g(x) — g(a) will have an expansion in h with no 
constant term. Thus the expansions for the powers of A; in terms of h 
may be obtained by the method used to deduce (197). If we then 
wish to expand f[g(x)] in powers of h, we first expand f(u) in powers of 
u — b, where b = g(a) so that when u = g(x), u — b = g(x) — g(a ) * 
k, whose powers we have just discussed. For example, if /(«) = 1/u, 
we use: 


1 _ 1 _ _ 1 1 

u b + k b k 

l + b 


1 - L *L 

b b 2 + b 3 


- 5 + 0(f). 


(209) 


an expansion which has (201) as a special case. 
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Since the combinations of elementary functions here under considera¬ 
tion have derivatives of all orders, we know that the expansions exist, 
so that we may use the method of undetermined coefficients. The 
ordinary process of long division for quotients, and the methods of 
finding an expansion from that of the inverse function, or from that of 
the derivative we illustrated for sin -1 x, are equivalent to this method. 

Since the expansions are uniquely determined, no matter what method 
we use, the development will be the same as that obtained by differentia¬ 
tion. The methods of this section are often preferable to a direct 
calculation of the higher derivatives which occur in equation (189). 

84. Alternative Form of l’Hospital's Rule. The discussion of sec¬ 
tion 82 enables us to prove the following alternative form of l’Hospital’s 
rule for the indeterminate form 0/0. 

If the functions f(x) and g(x), as well as their derivatives of all orders from 
one upton are zero for x = a, so that: 


f(a) = 

}'{a) - /"(a) = ••• =/ <n> («) = 0, 

(210) 

g(a) = 

g'(a) = g"(a) = • • • = 0 (n) (a) = 0 , 

(211) 

and each function has 

a derivative of the (n + l)st order at a , with 



g (n+1) (a) ^ 0, 

(212) 

then 

fix) / <n+1) (a) 
g(x) g {n+1) (a) 

(213) 

If we apply equation (187) to each of our functions, noting that the 
polynomial P(h ) is zero in view of the conditions (210) and (211), we 

have: 

f(a + h) / (n+1) (a) 

£2 h B+l (n + l)!’ 

(214) 

and 

.. g(a + h ) p (n+1> (a) 

£2 h n+l (n + 1) ! 

(215) 

It follows from these by division that 



f(a + h) / (n+1) (a) 

h^og(a + h) p (n+1) (o) , 

(216) 


which is equivalent to equation (213), the conclusion of the theorem. 

In this theorem, when x —* a+, we only need right-hand derivatives, 
and when x—>a—, we only need left-hand derivatives. If the deriva¬ 
tives are not restricted in this way, the theorem applies when x —* a. 



Art. 84] ALTERNATIVE FORM OF L’HOSPITAL'S RULE 


131 


Also if one, but not both, of the derivatives / (n+1) (a) and 0 <n+1) (o) 
is +» or — eo, we may deduce the behavior of f(x)/g(x) from the 
equation (213) by the principles of section 20. 

Whenever the functions f(x) and g(x) possess derivatives of the 
(n + 2)nd order at a, and hence Taylor’s developments of the (n + l)st 
order, we have: 

f(a + h) - An+ih"* 1 + 0(h n + 2 ), (217) 

and 

g(a + h) = B n+1 h n+l + 0(h n+2 ), B n+1 * 0. (218) 


It follows from these expansions that: 


lim 

£■—►01 


m 

g(.z) 


A n +1 

- • 

#n-fl 


(219) 


This is in accordance with equation (213), since the right member of 
equation (214) is A n + 1, while that of equation (215) is B n + x . But, if 
the Taylor’s developments for f(x) and g(x) are known, or can be easily 
found by the methods of section 83, it is simpler to verify equations 
(217) and (218), and apply equation (219), than to verify equations 
(210) and (211), and apply equation (213). For example, to evaluate 


tan x — sin x 

lim —rii-> 

x —+o sin x — x 


( 220 ) 


we deduce from equations (203) and (193) that 

x 3 

tan x — sin x - —■• + 0(x 5 ), (221) 

A 


and from equation (206) that 

x 3 

sin 1 x — x = — + 0 (x 5 ), (222) 

6 


so that the value of the limit (220) is 3. 

Again, whenever the (n + l)st derivative is continuous at a, the 
equation (213) may be deduced by (n + 1) successive applications of 
the rule proved in section 80. In many cases such successive applica¬ 
tions permit us to make simplifications at intermediate stages such as 
cancellation of factors, or replacing factors whose limits are known 
and different from zero by their limits. Thus, if we apply the earlier 
rule to evaluate the limit, as x -* 0, of / {x)/g (x) = sin 3 xf sin x 3 , we find 
that: 

f (x) 3 sin 2 x cos x _ / sin x \ 2 cos x 

g'(x) ~ 3x 2 cos x 3 ~ \ x ) cos x 3 * 


(223) 
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so the limit oif(x) Jg (x) is 1. This limit could also have been found 

by writing 

M „ (Jt\ or (224) 

g(x) \ x / \sin a.' 3 / gix) x 3 + 0 (x 9 ) 

The theorem of this section does not appJv to such cases as lim^ ^ > 

except to prove that its reciprocal approaches 0,"s& 2&*t its numerical 
value becomes infinite. However, the rule of section 80 show! 8 that the 
expression —*■+«>. 

When the (n + l)st derivative is not continuous at a, the equ.^ 1011 
(213) may give a result, while the equation (149) does not hold. \,^ n 
example, with n = 0, is ' 

2 • 1 
x sin - 

, x 0 

lim —:- =- = 0. (225) 

x-*o sm x 1 

85. L’Hospital’s Rule for the Indeterminate Form «>/<». If 
lim |/(x)| = oo, and lim |g(x)| = oo, the expression f(x)/g(x) may 

approach a limit when x—* a. As this limit can not be predicted without 
further information about the functions, this situation is described as an 
indeterminate form *> /«. We shall now show that the rule given in 
section 80 for the indeterminate form 0/0 applies also to the form 
oo/oo. That is: 

If lim fix) = oo, lim g(x) — oo, 

x—*a+ x —►a-f 

f'(x) 

and lim -y-— = L, (226) 

x—►a-f 9 (X) 

f(x) 

then lim -t-t = L. (227) 

*-*>+ gix) 

The theorem remains valid if we ref lace Lby +&, or by — oo. Also we 
may replace x —*■ a+ by x a—, or by x —* a in each of the places where it 
occurs. 

To prove this, we select an open interval a < x < a + h, in which 
fix) and g(x) each has finite derivatives. Then, for any two points 
X\ and x in this interval, with x\ > x, we have 

1 /fa) 

fix) m hx) -m) _f( Xo )' 

gix) , g(x i) * gix) - gix i) “ g'(xo)’ 


( 228 ) 
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where Xo is a suitable point satisfying x < Xo < Xi by the generalized 
mean value theorem of section 79. 

We may rewrite this equation in the form: 


1 _ gfo) 

fix) = g(x) /(x 0 ) 

g(x) /(xi) /(x 0 ) 

fix) 

Next select a such that 


fix) 

g'ix) 


< 


if 0 < x — a < 5j, 


(229) 


(230) 


which we may do in view of the condition (226). 

Then take a particular value of Xj, such that a < Xi < a + Si, and 
a number S such that: 


7(xi) 

/(X) 


< e, and 


ff(xi) 


ff(x) 


< e, if 


0 < x — a < 5, 


(231) 


iwhich we may do since the numerators of these fractions are fixed, while 
the denominators become infinite as x —> a. 

We then have: 


^ = 7--(L + «i), if 0 < x — a < 5, (232) 

where jail < €, |a 2 | < |oc 3 | < e. (233) 

Now take a sequence of values of € approaching zero and a corre¬ 
sponding sequence of values of 8 approaching zero. Then, for any 
l sequence of values of x —» a+, we may write a series of equations (232) 
| with € and hence au a 2 and a 3 all approaching zero. It follows from 
| this that 

lim ~~ = L, (234) 

x-+a+g(x) 

so that we have proved equation (227). 

When L is replaced by + <» in equation (226), we select such that 

Q%>-, if 0 <*-«<«!, (235) 

g (x) « 

so that if we put f{x)/g'{x) — l/«i, 0 < ai < e. We then have in 
place of equation (232), 

fif) _ 1 ~ 02 
g(x) 1 - as «i ’ 


ai > 0, 


(236) 
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f(x) 

hm - 7 — «* +«. 

»-*«+ 0(2) 

5. Indeterminate Forms for x —> + w. If 

lim f(x) = 0, and lim g(x) — 0, 

y .-»~|-00 


(237) 


(238) 


we may reduce this to the case discussed in section 80 by making the 
change of variables: 


y «* - > so that y —* 0 +, when x —* + 00 . 
x 


If we define 


F(y) =/y -/(*), and G(y) = g 


© ' #w ’ 


(239) 


(240) 


we have: 


F'(y) » -1/0 = -x 2 f'(x), and G\y) = -x 2 g'(x), (241) 

F'(y) f'(x) 


so that: 


This shows that, if 

we have: 

m 


G'(y ) g\x) 


' 111 ~ 
9—+»g (X) 


(242) 


(243) 


,v-, F(y) F'(y) f\x) r 

hm -r-r » lim -=j- = hm - 7 - - = hm - 7 -— = L. (244) 

*_H*6ff(aO *-*o+Gu/) v—<h-G(|/) *—+«g (x) 


This proves that l’Hospital’s rule as stated in the theorem of section 80 
remains valid if we replace x —> 0 + by x —► + ». 

This is also true if we replace x -* a+ by x —* — », or |x| —» *>. 

The same argument reduces the case in which 

lim j/(x)| = 00 , lim' !g(x)| == <», (245) 

to the case discussed in section 85, and shows that the rule of that section 
may be similarly extended. 
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87. Other Indeterminate Forms. If lim fix) = 0 and if lim |(K*)| 
*= oo, we speak of the limit of f(x)g(x ) as the indeterminate form 0 • oo. 
We may sometimes evaluate this limit by the preceding rules, since 

(246) 

00 ) / 0 ) 

which are respectively indeterminate forms 0/0 and co / oo. 

Again, we speak of f(x) g{x) as an indeterminate form, when the limits 
of fix) and g{x) are both 0 , in which case we have the indeterminate 
form 0°, or are those indicated by 1 °° and °o°. These may be reduced 
to the discussion of an indeterminate product 0 • qo by taking logarithms, 
since in each of these cases the product g (x) log f(x) has the limit of one 
factor zero, while the other factor becomes infinite. 

Similarly the form f{x) — g(x), where f(x) and g(x) each become 
infinite, may be reduced by 

JL_1_ 

(247) 

f(x)g(x) 

or some similar transformation to a case to which FHospitaFs rule 
applies. 

In all these cases, whenever the Taylor’s developments are at hand, 
they may be used to shorten the calculation. As an example, consider 
the limit when x —* 0 of J{x)° {x) , where 

f(x) = 1 + ax + o(x) and xg{x) * b + o(l), (248) 

so that this is an indeterminate form 1 °°. From the Taylor’s develop¬ 
ment 

log (1 + u) = u + 0(u 2 ) f (249) 

we deduce that 

log f(x) « ax + o(x), g(x) log fix) « ab + o(l), (250) 

so that 

lim fix)« x) = «•». (251) 

as—^0 

88. Vanishing Factors. In the application of l’Hospital's rule, it is 
desirable to make algebraic simplifications of the fraction }' {x)fg t {x), 
as we indicated in section 84. 
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But one must not cancel out a factor from f'(x) and g'(x) which 
vanishes in every neighborhood of a, the value at which the limit is 
taken. The presence of such a factor makes f{x)/g\x) undefined for 
one sequence of values approaching a, and so the limit does not exist in 
the sense required to prove PHospitaPs rule. 

In fact, it is possible for f'(x)/g'(x) to approach a limit A for all 
sequences of values not including this one sequence of values, while 
f( x )/9( x ) either fails to approach a limit, or approaches a limit distinct 
from A . 

Similar remarks apply when we take the limits as x + oo , if there 
is a factor vanishing for arbitrarily large values of x . 

An example is 

f(x) = x — sin x cos x , g(x) — (x — sin x cos x) p e°° B x f (252) 


where p > 0, and we consider the limit of f(x)/g{x) asx-> + oo. By 
using the fact that 


we see that 


.. x — sin x cos x 
Inn -- 1, 

X — ►-j-00 X 


ffr) 

ff(x) 


= M& 1 -*, 


(253) 

(254) 


where M\ has a finite upper limit e and a lower limit greater than zero, 
1/e. 

The derivatives of the functions are: 


f'(x) = 2 sin 2 x, 


(255) 


and 

g f (x) = (—x + sin x cos x + 2p sin x) sin x (x — sin x cos x) p ~ 1 e°°“*. 


(256) 


Thus we may write: 


/(*) 

/(*) 


= -M 2 x- p 


sin 2 x 
sin x 


(257) 


where Mz has its upper and lower limits finite and positive. This shows 
t.hftf . f{x)/g\x) is undefined for the sequence x - rnr, for which 
sin * =*= 0. If we avoid these values, we may cancel out the factor sin x 
sad so have: 


to 

« g (x) 


i£ x' nw, 


0 . 


(258) 
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But, if p = 1 , f(x)/g(x) — Mi oscillates between finite limits, and so 
fails to approach any limit. If p < 1 , e.g., 2/3, f{x)/g{x) becomes 
positively infinite. 

By considering 

F(x) 

= Af(x) + Bg{x), G(x) = f(x) + g{x), 

(259) 

derived from the functions of equation (252), we have: 


while 

r F 'W d / ^ 
hm —f --- = By x 7 ^ nr , 

z'-»-+oo Or (X) 

(260) 


V F( - X) A ■ f 2 

hm r(- r \ =A > lf 

(j (X) 6 

(261) 


and F(x)/G(x) oscillates, and so approaches no limit, if p = 1 . 

89. Taylor’s Theorem for Finite Increments. The theorem of sec¬ 
tion 82 suggests that, for certain values of h , the polynomial P(h) of 
equation (189) has a simple relation to the function/(x), and we pro¬ 
ceed to study this relation in more detail. 

In section 82 we merely assumed the existence of the (n + l)st 
derivative at the point a itself. We shall now assume that the function 
f(x) has a finite (n + l)st derivative at all points of the closed interval 
a g x g a + h. In this case we may apply the generalized mean 
value theorem to the functions 

F(h) = f(a + h) — P(h ), G(h ) = h n+ \ (262) 

to obtain: 

F(h) _ F(h) - F( 0) = F\h x) 

G(h) G(h)-G( 0 ) G'(hi )* { } 


since F(0) and (?(0) are each zero. But, since F(h) and G(h) each have 
their derivatives of the first n orders zero for h — 0, we may repeat this 
process n times more, and so find: 



F'(hi) F"(h 2 ) F< n+1) (/ln+l) 

G’ihi) G"(h 2 ) G (n+ 1 ) (h n+ i) 

(264) 

Since 

0 < fc„ + 1 < h n < ■ • • < h 2 < hi < h, 

(265) 

we may write 

h n +i — Oh, where 0 < 6 < 1, 

(266) 

and conclude that: 



/(a + h) - P(ft) f (n+1) (a ± 6 h) 
h n+1 (n + 1) ! 


(267) 
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We have thus proved one form of Taylor’s theorem for finite increments, 
which we formulate as follows: 

If the function f(x) has a finite (n + l)st derivative at aU points of the 
dosed interval a £ x £ a + h, then there is a value of 9 between zero and 
one, for which: 

f(a + h) - /(a) + / (a) A + f'\a) ^ + • • ■ 

h n A n+1 

+ / <n) (a) ^ + / (n+1) (a + 6h) (n + 1 ) ; • (268) 

If we put a + h = x,h = x — a, the result may be written: 
m - Ha) + f'(a) + /"(a) {± ~- + ••• 

+r”» + />" +1> «) ■ « 

7i ! (ti 4“ 1) ! 

where £ is a suitably chosen value between a and x. The equation just 
written will hold for any value of x in the closed interval a g x ^ b, if 
the function f(x) has a finite (n + l)st derivative throughout this 
interval, and if £ is appropriate to this x. 

The difference between the function/(a + h ) and its Taylor’s develop¬ 
ment P(h), the F(h) of equation (262), is referred to as the remainder 
for the development. Thus the equation (267) determines one expres¬ 
sion for the remainder. The theorem, as expressed in equations (268) or 
(269), is often called Taylor’s theorem with the remainder. The special 
case with o = 0 is called Maclaurin’s theorem. 

II, throughout the closed interval a,b the numerical value of / <B+1) (x) 
admits the upper bound M, the numerical value of the remainder, or 
error made by using the first n terms of the Taylor’s development, 
P(h)orP(x — o) in place of f(x) will not exceed M (b — a) n+i / (n + 1) 1 
at any point of the interval. This enables us to use the developments for 
computation, for which the first form, P(h), is usually preferable; the 
error being numerically at most Mh n+1 /(n + 1)1 

90. The Limiting Value of 0. While we can usually say little about 
the value of 9 beyond the fact that it is between 0 and 1, we can deter¬ 
mine its limiting value as h approaches zero, if the function has a deriva¬ 
tive of coder one higher than that used in the term involving a + 6h, 
and! this derivative is continuous and not zero at a. 

Let uS assume that/ (n+1) (x) is continuous at a, and therefore finite in 

’ ^ onnlv on nation ( 268 ). both as 
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written, and with n replaced by n — 1, and 6 replaced by 6 n . Then, by 
equating the two expressions for/(a + A) so obtained, we find: 

r(a + W) £ - n.) f ,+/<■«' <« + w 

or 

/"(a + 0„A) -/•(«*)+ / (n+1) (a + «*) • 

But, from the law of finite increments, applied to/ (n) (a;), we have: 

r (« + M) = /"(a) + (a + W«A), (272) 

for a suitable choice of do between zero and one. 

From the last two equations, we deduce that: 


(270) 

(271) 


1 f (n+1) (a + Oh) 

n+lf n+1) (a + d 0 e n h)‘ 


(273) 


Finally, by taking the limit of this expression as A approaches zero, and 
recalling that / (n+1) (x) is continuous at a, while / <n+1> (a) ^ 0, we deduce 


lim 6 n = — j — • (274) 

h —►0+ Yl "j - 1 


The same argument applies for negative values of h. 

This proves the theorem, formulated with the n of the proof replaced 
by n + 1: 

If the function f(x) has an (n + 2)nd derivative , continuous and not zero 
at a t the 6 in the remainder term of equation (268), 

/i n+1 1 

f n + l) (a + 6h) --— t is such that lim $ = —— * (275) 

(n + 1) ! h-o n + 2 


91. Other Expressions for the Remainder. We may obtain the 
expression for the remainder term in Taylor’s theorem given in equation 
(268), as well as some other expressions which are sometimes useful, by 
a shorter but less natural approach than that of section 89. As in that 
section, we assume that the function f(x) has a finite (n + l)st deriva¬ 
tive throughout the closed interval a £ x £b. 

We next select some particular function g (x ), having a finite derivative 
g\x) & 0 at all points of the open interval 0 < x < b — a. The func¬ 
tion g(x) is to be continuous at the end points of the interval, 0 and 
b — a, and must have g(0) * 0. 

The function g{x) is otherwise arbitrary, and each choice of this func¬ 
tion will lead to a special form for the remainder. 



140 DIFFERENTIATION [Chap. IV 

We note that we may apply the law of finite increments to g(x) and 
so obtain: 

g(b - o) * g(b - a) - g( 0) = (b - a) g'(() 0. (276) 

Since g(b — a) 7 * 0, we may solve the equation: 

m - /(a) + /'(a) + /"(a) + • • • 

+ / (n) (a) + <?<?(6 - a), (277) 

n ! 

for the value of (r. Let G then be a constant, defined by this equation. 
Next define a function F(x ) by the equation: 

F(x) = —f(b) +f(x) + /'(*) + f"(x) + ■■■ 

+ T(x) - ~, X ) - + Gg(b-x). (278) 

While these definitions require no logical justification, the reader 
may find some motivation for them if he observes that, if the remainder 
term is expressed as a constant times g(h), or gib — a), then the equa¬ 
tion (277) follows, while the right member of equation (278) may be 
obtained from equation (277) by transposing the term fib) and then 
replacing a by x. 

We now apply Rolle’s theorem, section 73, to the function F(x). The 
function F(x) has a derivative for a < x < b, sine ef(x) has an (n + l)st 
derivative throughout this interval, while g(b — x) has a first derivative 
in this interval. Also, our conditions on f(x) and g{x) make Fix) con¬ 
tinuous at the end points of this interval. Finally, F{a) = 0, by equa¬ 
tion (277), while F(b) = 0, as we see from equation (278), if we recall 
that g( 0) = 0. Thus, since all the conditions of Rolle’s theorem are 
met, for some point between a and b, 

F'(Z) = 0. (279) 

When we differentiate the right member of equation (278) most of the 
terms cancel in pairs, and we find: 

F'(x) « / (n+1) (x) ~ - Gg'(b - x). (280) 

n ! 

But;, since F'(£) = 0, we may deduce from this that: 

(b - {)» / (n+1) (£) 
n! g'(b-l-)’ 


O 


( 281 ) 
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so that the remainder, Gg(b — a), is given by 

0,(b - a) - /■«> (i) • (282) 

If we put b = a -f h, £ = a + 0ft, and write 

/(a + fc) = P(/i) + R(h), (283) 

we may express the remainder in terms of h : 

« W = (h) - (1 - 0)V (n+1) (a + 0A) • (284) 

Since the equations (279) and (282) held for a suitable value of £, 
a < £ < b } it follows that equation (284) will hold for a suitable value 
of 0 with 0 < 0 < 1. 

If we now specialize the function g(x) by putting g(x) = x p , where 
p is any positive number, we find the expression: 

h nJrl 

R(h ) =-- (1 - *)»-*+i/<»+i)(a + 6K), (285) 

pn ! 

a form due to Schloemilch. 

If we further specialize this by putting p — 1, we obtain: 
h n+1 

R(h) = —- (1 - 0) n / (n+1) (a + Oh), (286) 

n ! 

or Cauchy’s form of the remainder. 

If we put p = n + 1 in equation (285), we find: 

A n+1 

R(h) = (^Tf! /(n+1) (a + 9h) ’ (287) 

or Lagrange’s form of the remainder, which we have already derived in 
section 89. This is generally the most useful form. However, in a few 
applications the Cauchy form is preferable. 

92. Orders of Infinity. In section 81 we defined a series of infinitesi¬ 
mals of integral order with respect to a fundamental infinitesimal, h. 
In a similar way, we may select a particular quantity H which is becom¬ 
ing positively infinite, and refer other quantities becoming infinite to it. 
Thus H n would be of the nth order, with respect to H. 

As for infinitesimals, we say that K\ and K 2 are of the same order of 
infinity if K\/K 2 approaches a finite limit greater than zero. When 
K 1 /K 2 —» + *>, so that the limit of K 2 /Ki is zero, we say that Ki is of a 
higher order of infinity than K 2 , or that K 2 is a lower order of infinity 
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thaniTi. We may write in this case K 2 = o(K{), in accordance with the 
definition of equation (160). In this way we may indicate that a posi¬ 
tive variable is becoming infinite by 1 = o{K). 

We also use the notation of equation (169), defined by equation (170), 
for variables with any behavior. Thus K 2 = 0{K\) if the order of 
infinity of K\ is the same or higher than that of K 2 . 

The theory of quantities becoming positively infinite may be reduced 
to the theory of positive infinitesimals by putting H — 1/A, analogous 
to the use of equation (239) in section 86. This would lead us to think 
of positive orders of infinity being negative orders of infinitesimals, and 
conversely. However, it is better to have both points of view at our 
disposal. 


The simplest quantities becoming infinite which are not comparable 
to powers of H, are exponentials. In fact, if we apply equation (268) 
with a — 0 and h = x to f{x) = e x , we find: 

e - 

/>»7l 1 

1 + x + — + ••• + — + .-. A 

2 ! n ! (n + 1) ! 

(288) 

If x is positive, all the terms of this expression are positive, 
any integer n, 

n 

Hence, for 


e* > —,» x > 0. 

n ! 

(289) 

It follows that 



1 n ! , x p n ! 

— < _ and _ < • 

x n e x np 

(290) 


If we take x — H, a quantity becoming positively infinite, for any fixed 
number p we may take » > p and deduce from this that: 


= o(l) or H p - o(e B ), (291) 

er 

which shows that e B is a higher order of infinity than any (large) positive 
power of H. 

If H is becoming positively infinite, K = log H also becomes positively 
infinite, as we showed in section 43, equation (48). However, log H is a 
lower order of infinity than H, or any (small) positive power of H. To 
see this, let q be may positive number and apply equation (291) with 
p m 1/q to the variable K. Then: 
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since any positive power of an infinitesimal is an infinitesimal. Finally, 
put K *= log H in the last relation, and so obtain: 

log H 

~gT 1), or log# = o(H q ). (293) 

By putting H = l/h in the equations (291) and (293) we find the 
corresponding relations for positive infinitesimals, 

/l\ p -- -1 

f-J e h - o(l), or e h = o(h p ), if h > 0, (294) 

and 

log h 9 = o(l), or h 9 = o ^» if h >0 . (295) 

These relations may all be kept in mind by referring them to the 
following basic facts. If H —* + oo, the exponential e H is a higher order 
of infinity than the variable H , and the logarithm log H is & lower order 
of infinity than the variable H. Moreover, these relations are not 
disturbed by raising any of these quantities to positive powers, so that 
if p, q, and r are all positive, e PH is of higher order than H 9 , and H 9 is of 
higher order than (log H) T . These principles often enable us to detect at 
once when certain combinations of simple functions become infinite or 
approach zero. 

For example, e ax x b (log x) c , for x —* + oo, becomes positively infinite 
if a > 0, and approaches 0 if a < 0, regardless of the values of b and c. 
If a = 0, the behavior depends on the sign of b, and if a = b — 0, on the 
sign of c. Similar remarks apply to e a/x x b |log x\ e , for x —* 0+. 

We may now appreciate to some extent the incompleteness of a scale 
of positive infinitesimals consisting only of positive powers of h, h p . 
For an infinitesimal such as Jlog h\ 9 h 2 is of higher order than any h p 
with p < 2, and is of lower order than any h p with p 2: 2. If we 
admitted powers of |log h\ such expressions as log jlog h\ h 2 would remain 
unclassified. This is why we defined only integral orders. 

If P, Q, and R are any three polynomials, or other functions of x hav¬ 
ing the same order of infinity as some positive power of x, the behavior 
of (log R)° as x —* + <*> may be deduced from our basic principles. 

The property of the exponential function expressed in equation (291) 
is not possessed by any function y = /( x) which satisfies a polynomial 
relation P(x,y) = 0, that is by any algebraic function. For, let a:** = o(y) 
as * —» + °o for all p and hence in particular for all the powers of * in the 
polynomial P(x,y). Take Ax m y n as the term in the polynomial such 



144 


DIFFERENTIATION 


[Chat. IV 


that A 9 * 0: no higher power of y than y n occurs, and no term in y n 
with a higher power of x than x m occurs. Then we may write: 

P(x,y) = Ax m y n + o(x m y n ). (296) 

This contradicts our assumption that when y = f(x), P(x,y ) = 0, 
since it makes \P(x,y)\ —* » as x, and hence y — * + ». 

The considerations just mentioned prove that the exponential and 
logarithmic functions are not algebraic functions. 

93. Finite Differences. If a function is tabulated for a series of 
values differing by the same positive quantity a, we may, by subtraction, 
form the first difference for any value of x used as an entry in the table; 
namely, 

A/(z) = f(x + a) - f(x). (297) 

The second difference is the first difference of the first difference; namely, 

A 2 /(a;) = A f(x + a) - A f(x) = f{x + 2 a) - 2 f(x + a) + f(x). (298) 

The higher differences are defined by induction, the nth difference 
being the first difference of the (n — l)st difference. The nth difference 
may be expressed directly in terms of the values of the function by a 
formula similar to equation (298) involving binomial coefficients. In 
fact, if A is a symbol of operation meaning that the argument is to be 
increased by a, then 

A f= (A- 1)/, and A7 = (A - 1)7, (299) 

and the formula in question may be obtained by expanding this by the 
binomial theorem and noting that A m is the operator which means that 
the argument is to be increased by ma. 

We shall prove that if the function/^) has an nth derivative through¬ 
out the open interval x,x + na, and the (n — l)st derivative is con¬ 
tinuous at the end points of this interval, then 

A n f(x) = a n f n) (x + dna), (300) 

where 0 is a suitably chosen number between 0 and 1. 

For n equal to 1, this is the law of finite increments. Thus we need 
merely prove that its truth for n follows from that for 1, 2, ••*,» — 1 
to establish the result by mathematical induction. 

But, if the nth and (n — l)st derivatives of f(x) satisfy the required 
Conditions, the function: 

V A f(x) — f(x + a) — f(x) (301) 

also does, so that, as a consequence, its (n — l)st derivative exists in 
the ooen interval, and its (n — 2)nd derivative is continuous at the 
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end points. Hence, by the hypothesis of the induction, we may apply 
the equation (300) to the function A f(x), with n replaced by (n — 1). 
This gives 

A n /(x) = a n_1 {/ (n-1) [x + a + d'(n - l)a] - f^[x + fl'(» - l)o]}, 

(302) 

for a suitable value of 6 9 between 0 and 1. 

The conditions on the derivatives of f(x) show that the right member 
of equation (302) has a first derivative in the open interval, and that the 
function itself is continuous in the closed interval. Thus we may apply 
the law of the mean to the difference in brackets to obtain the result: 

a n / (n) [x + d"a + 0'(n - 1)4 (303) 

Here 0 /; , like 0' is a suitably chosen number between 0 and 1. Conse¬ 
quently 

6 rf a + 0 f (n — l)a = dna, (304) 

where 0 is a suitably chosen number between 0 and 1. 

By combining this equation with the expression (303), which was 
obtained from A n f(x), we find: 

A n /(x) = a n / (n) (x + 0na), (305) 

which is the result for n, and completes the proof by induction. 

We note in particular that if the function f(x) has an nth derivative 
continuous in the closed interval, the conditions are satisfied, and equa¬ 
tion (300) holds. 

Next suppose that the function /(x) has a finite nth derivative for a 
particular value. Then, in some neighborhood of this value it has an 
(n — l)st derivative, and hence a continuous (n — 2)nd derivative. 
Thus, for a sufficiently small value of a , we may deduce the equation 
(302). 

But, since the function f(x) has an nth derivative at x, it follows that 
/ (n “~ 1) (x) is differentiable at x, and we have: 

/ (n - n [z + a + e’(n - l)o] - / (n - x) (x) = 

[1 + <?'(»- l)]o [/<"> (x) +«], (306) 
and 

/<*-!)[* + e'(n - l)fl] - (x) = B\n - 1)0 [/ (n) (x) + a'], (307) 

in which a and a are infinitesimals, approaching zero with a. 

It follows from these two equations, and equation (302), that 

A VC*) = a n [/ (n) (*) + 01 , 


(308) 
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where 0 is an infinitesimal. If we put o « Ax, we may write 


A*-*0 Ax* 


f n) (x ). 


(309) 


EXERCISES IV 


1 . Prove that the function defined by /(x) = (x 2 ) w sin (x~ 2 ) n if x ^ 0 and 
/( 0 ) * 0 has a derivative for x «= 0 if m exceeds 1 /2 and if n is positive. 

2* Show that the derivative in problem 1 is continuous at 0 if 2 m exceeds 
2 n '4~ I. 

3. If f(x) = x cot -1 x when x 9 * 0 , and /( 0 ) = 0 , find the right-hand deriva¬ 
tive and the left-hand derivative for z — 0. Ans. ir / 2 , — r / 2 . 

4. Find the right-hand and left-hand derivative at zero of the function 

x/(l + e l/x ) with/(0) = 0. Ans. 0,1. 

5. Prove that, if y = /(u) and u = g(x) have derivatives for values of x 
near, but not equal to xo, and values of u near, but not equal to g(x 0 ), and 
fb(x)]g f (x) —> L as x—»Xo, then dy/dx = L. An example is 3 / = u m , u = x* 
with m and n both positive and mn = 1 , but one of them greater than 1 . 

6 * Prove that if all the elements of a determinant are differentiable functions 
of x, the derivative of the determinant is the sum of the n determinants obtained 
by replacing in succession each row (or each column) by the corresponding 
derivatives. 

7* If y% 9 V 2 f • • *, y n are n functions of x, the determinant 


W « 


Vu 3 / 2 , 

yi 3 / 2 , 


* * * » Vn 

* * * t lin 


Vl i 3/2 1 > £/» 


is called the Wronskian of the n functions. Show that dW jdx may be obtained 
by replacing the elements of the last row, y^ l) by y { ?\ Hint : Use problem 6. 

8+ If the functions of problem 7 are each solutions of the linear differential 
equation 

y (n) * On--j -b a>iv' + Oo2/> 

where the coefficients may be functions of x, prove that their Wronskian satisfies 
the differential equation dW jdx = a n _iW. 

9. If the Wronskian of two functions y% and 3 / 2 , TP * 3 / 13/2 — 3 / 23/1 never 
vanishes, show that the zeros of 3/1 separate those of 3 / 2 , in the sense that if 
jk(o) ** « 0, y* is not zero at a and 6, and is zero at least once in the 

interval a, 6 . if inf; Assume 3/2 5 ^ 0 in the interval, and apply Rolled theorem 
to yi/y* to obtain a contradiction to the hypothesis yi 9 * 0 for a < x < b. 

10a Let x(t) be the function defined in Exercises II, example 35. Show that, 
for any i©, if o*»-i is replaced by a new digit differing from it by unity, to change 
Lto 4- Af* with At *» ri=l IP*"" 1 , then lAx/Afl «* 3**~ l . If. for fo, 02 »~* is 0 
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or 2, and we replace it by 2 or 0, Ax/At * 0. If a 2n ~2 is 1, and <Hn « 1, and 
they are replaced by 0,0 or 2,2, Ax/At will be zero if o^n-i * 1, and otherwise 
will be ±3 n /5. Combine these facts to show that for every £o of the interval 0,1 
there are sequences of values of Ait approaching zero for which two of the 
three conditions Ax/A\t —> 4^ 00 , Ax/Ait —► — oo, or Az/Ait —> 0 can arise. 
This proves that the function has no finite or infinite derivative at any point of 
the interval, although it was proved continuous on this interval in the earlier prob¬ 
lem. This example of a possibility first noted by Weierstrass is due to Peano. 

lit If (xo,yo) is a point on the graph of y = f(x), so that yo = f(x o), show that 
y — yo + f(xo)(x — xq) passes through the point x 0 ,?/o and has the same deriva¬ 
tive as f(x) at that point, and that no other first degree expression in x has this 
property. It is the familiar tangent line. 

12. Prove that, if dy is the differential, and Ay the increment corresponding to 
dx = Ax, thenlimdx/Axas Ax—> 0 is Itfdy/dx = f(x) ^ 0, but is 0 if f(x) = 0. 

13. Show that if x and y are the coordinates of a point on any second degree 

d 3 

curve, or conic section, that —- (y"~ 2/ S ) = 0. (Halphen) Hint: Find y"~ 2/l 

dx 3 

from y = ox + b 4r \/cx 2 + dx + e. 

14. If x and y are the coordinates of a point on any parabola, show that 

(y"~ 2/3 ) == 0. (Halphen) Hint : Find y"” 2/3 from y * ax + b it: V dx + e. 

dx 2 

15. If the function y satisfies a differential equation ( ax 2 4* bx + c)y " + 
(dx + e)y' + fy = 0, prove that each of the higher derivatives of y satisfies an 
equation of similar form. Hint: Use the rule of Leibniz to differentiate each 
part of the equation n times. 

13. Prove that the higher derivatives of the function x = f~ l (y) inverse to 
y = f(x) may be found from 

d?x = -y" . d*x _ 3(y") f - y"'y' * 

dy 2 (v') 3 an dy 3 (y') b 

17. If f(x) and g(x) are differentiable in the closed interval a,b prove that, for 
a suitable intermediate value of x, 

fix) f(x) — f(a) 
g'(x) g(b) ~ g(x) 

Hint: Consider f(x)g(x) — f(a)g(x) — g(b)f(x). 

18. Use the derivatives to determine the increasing or decreasing character 
of the six hyperbolic functions, and in particular show that cosh 0 = 1 is the only 
minimum, and sech 0=1 the only maximum. 

19. Show that the existence of a Taylor’s development of higher order does 
not imply that any derivatives except the first exist, by considering f(x) « 4 + 
x % + x 3 sin (x~ 2 ) near 0. 

20. If, as x +«, /'(x) —> L, then f(x) /x L. This also holds if L is 

replaced by 4* 00 » or — . Hint: Use l’Hospital’s rule. 

21. It f(x) +<*> or —oo, and f(x) —> M, as x —> +<*>, then f(x)0 . 
Hint: Us© problem 20. 



148 


DIFFERENTIATION 


[Chap. IV 


22* If /(x) + /'(x) —> L as x + 00 , then /(x) L. Hint: If f'(x) ulti¬ 
mately preserves its sign, f(x) ultimately is monotonic, and either becomes 
infinite or approaches a finite limit. In the first case /'(x) becomes infinite with 
opposite sign, contrary to problem 20, and in the second f(x) approaches a 
limit, and we may apply problem 21. Otherwise there are maximum and 
minimum values, and m<, of f(x) for arbitrarily large values of x*, with 
/'(£*•) = 0. Hence M<—> L, and m ~> L, so that, since the other values of /(x) 
are between the maximum and minimum, f(x) —•> L. 

23. If r x is an approximate value of one root of the equation/(x) = 0, where 
f(x) has a continuous first derivative not zero in some interval including the 
root and ri, a second approximation to the root may be obtained by Newton's 
method. If r x + h is the root sought, then from 

0 = fin + h) - fin) + hf'in + eh), h = —=^--. 

fin + Oh) 

and if we tak ef(ri) as an approximation to /'(ri + Oh), the second approxima¬ 
tion is given by r 1 — /(r x ) //'(r x ) = r 2 . The process may be repeated. 

By applying the method to /(x) = x 2 — a, deduce the rule for improving the 
approximation to \/u, by starting with ri and taking the average of ri and 
o/ri as the second approximation. 

24. If the function/(x) of problem 23 has higher derivatives, deduce from the 
Taylor’s expansion of /(r x + h) that r x —f(r i) //'(r x ) -1/2 Lf(r x )] 2 /"(r x ) /[/'(r x )] s 
differs from the root by a term o(/i 3 ). This may also be shown by writing 
y = f(z) to define x in terms of y and expanding in a Taylor's series in powers of 
y — h t where h = /(r x ). The derivatives are found from problem 16, and 
y = 0 gives the root sought. 

25* If a is less than 0.1, the equation sin x = ax has a root near x. Show that 
(1 — a)ir, and (1 — a + n 2 )x are improved approximations to this root. 

26. Show that e x » 1 + x + z 2 /2 ! + ••• + x n /n ! + R n , where |i? n | < 
\x\ n + l /(n + 1) I if x < 0, and \R n \ < e x x n+1 /(n + 1) ! if x > 0. Hence show 
that R n ~-+0, if n —* +°o. 

27. Show that sin x « x — x 3 /3 ! + * • • + ( —l) n ' fl x 2n “‘ 1 /(2n - 1) ! + & 2 n, 
and cosx * 1 — x 2 /2 H— • + (~l) n x 2n /(2n) ! + # 2 »+i, where for each 
\Rm\ < \x\ m + l /(m + 1) !, so that R m 0, as m —> + oo. 

28. Use the expansions of problem 27 to deduce that: 

1 2 

tanx = x + -x 8 + ~z* + 0(x 7 ), 

x cot x * 1 — \x 2 — jr x 4 + 0(x 6 ), 
o 4o 

1 7 

and x esc x = 1 + 


22 . Prove the binomial theorem for all real m and all values of x with |x| < 1, 
namely, 


(1 + x) m * 1 + tnx + 


m(m — 1) * • • (m — n + 1) 
nl 


x n + R n 
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with R n —* 0 as n • 
_ m{m - 1 ) • 

K n — 


+ 00 . Hint: Use the Cauchy form of the remainder to find 

(m - n) (1 - 6 ) n x n+1 t L 

—— ---— -—-- 9 which may be written as the 

1-2.(n+1) (l + tfx)*”*^ 1 J 

product of a number of factors of the form (m — k) /(k + l)x, times a term inde¬ 
pendent of n, times (1 — 0) n /(l + 0x) n . The last does not exceed unity, and 
the factors in numerical value approach \x\ < 1, and so are ultimately less than 
1 — 5, 6 > 0. Thus ultimately R n is dominated by X(1 — £) n “" w », which—>0. 

30. If we use equation (208) to deduce /(x) = S n (x) + R n {x) from f'(z) = 
Sn(x) + Rh(x), show that if as n —* + <*>, R' n -+ 0, for |x| < a, then R n ~+ 0. 
Hint: Since R n ( 0) = 0, R n (x) = R n (x) — fl n (0) = xR' n {6x). 

31. Show that tan” 1 x = x — x 3 /3 + x 6 /5 — • • • + (—l) n+1 x 2n “ 1 /(2n — 1) + 


j? 2 n, and sin ” 1 x = x H- 7 - + • • • + 

2*3 


1*3* 


(2 n - 1 ) 


n ! 2 n ( 2 n + 1 ) 


x 2n+1 /j> 2tv+2j where 


in each case, = 0(x m+1 ), and —> 0 as m—> + 00 • Hint: Use problems 30 

and 29. 

32. Prove that 7 r /4 = tan ” 1 1 = 4 tan ” 1 (1/5) — tan ” 1 (1/239). This may 
be combined with the first expansion of problem 31 to compute t conveniently. 

33. Prove log (1 + x) = x — x 2 /2 *+•••• + ( —l) n+ 1 x n /n + Rn, where R n = 

0 (x n+1 ), and if |x| < 1 , —» 0 as n —> + 00 . 

34. Show that, if 0 < x < 1, 


l »*(frf)' 2 (‘ + I + ''' + ^ri) 


+ Rtn, where 

\Rin\ < 


2 x 2n+1 


( 2 » + 1)(1 + x )** +1 


36. If in the preceding problem we put x = 1/31, 1/49 and 1/161, we may 
compute the values of P = log 16 /15, Q = log 25 /24 and R = log 81 /80. Show 
that log 10 = 2(23P + 17Q + 10 P). Such combinations are desirable to get 
the logarithms of small integers. After several of these are known, the differ¬ 
ence between the logarithm of any integer sought, and of one known from its 
factors may be found directly from problem 34 with a small value of x. 

36. Verify each of the following limits as x —* 0 : 


ci x b x . fa 

(a) hm-- log I - 

x \b 


(b) lim 


x — tan - 


sm" 


-1 r. - 


= 2 ; 


tan x - x 

(c) urn-— 2 . 

x — sin x 


37. Show that, as x —> 0 : 


(a) — — cot 2 x — 
x 2 

(C) 


(b) 


2 

» - y 

3 

1 — cos (1 


x sin (sin x) — sin 2 x _ 1 _ 
x 6 18 5 

— cos x) 1 


88 . Prove that when x —» 0 , 

(a) |x|*—► 1 , (b) (cos 2 x) oa ° ,8a? — 



e 


1 
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89. Verify that, as \x\ —► qo, 

V - 2 - 

tan~ x x J —► € r , 

TT |1 

')-tan"" 1 x * —> 1. 

2 j 

40. Prove that, if/(a?)—> 1 and ?(x)[/(x) - 1] —» L, then/(x)*< T > —> e L . 

4L If f(x) = e*“ l/x *, Zt^Oj and /(0) = 0, show that /Or) is continuous for 
x 0, and has derivatives of all orders at x ■ 0, with / (n) (0) =» 0. Thus the 
Taylor's development to any order is zero, and f(x) = o(x n ), for all n. Also, 
/(x) * R n (z), so that, in spite of its possessing continuous derivatives of all 
orders, we cannot compute the function from its Taylor's expansion. 

42. Prove that f(x) has a relative maximum at x ** a if /'(a) = 0 and 
f\a) < 0. More generally, if f(a) * /"(a) = • * • = f m ~ l) (a) ~ 0, and 

?£ 0,/(a) has a relative maximum if m is even and / (m) (a) < 0, a relative 
minimum if m is even and/ (w >(a) >0. If m is odd, there is neither a maximum 
nor a minimum. Hint: Use equation (187), noting that the conditions make 
P(h) 

43. Assuming that the (m + l)st derivative exists, deduce the rule of problem 
42 from Taylor's development. If A m h m is the first term with non-zero coeffi¬ 
cient in any development of f(a + h), we may infer the behavior at a from the 
parity of m and the sign of A m . For example, from problem 37(b) we may 
deduce that x sin (sin x) — sin 2 x has a minimum at x = 0. 

44. Use the test of section 76 to prove that the function of problem 41 has a 
minimum at 0. Note that the tests of problems 42 and 43 do not apply to this 
function. 

45. Obtain the development: 

(1 + *)■ - « [l - ! + lj*> - Jgi* + £>(»<)]. 

Hint: Use an( j develop the exponent. See problem 33 and 

(section 83. 

46. Prove that for 0 < x < w/2, 


(») (1 + xf-*e, (b) 0 


2 sing ^ 

v x 


1. 


Hint: The derivative of (sin x) jx is (x — tan x) (cos x) lx 2 . Since tan x > x, 
this is negative and the function decreases for all x between 0 and r 12. Hence 
the values of the function lie between the limits approached as x approaches 0 
and as * approaches *12. 

€7. Prove.' that o* > x“ if x > a gg e. Hint: The result follows from 
xloga > alogx, or /(x) > 0 if /(x) - x log a - a log x. But /(a) * 0, and 
f(x) »logo — o/x > 0, since logo 1 > o/x. 

„ * J 1 




CHAPTER V 


COMPLEX NUMBERS 

The discussion of the elementary functions may be simplified by the 
introduction of complex numbers, even if the chief interest is in methods 
which lead to final results expressible in terms of real numbers. There¬ 
fore this chapter is devoted to the study of complex numbers. 

We define such numbers and the four fundamental operations for 
them. We next enlarge the concepts of function, limit, and continuity 
so that they apply when the variables are complex, and we then define 
the basic elementary functions for complex values of the independent 
variable. 

We prove the fundamental theorem of algebra and apply this to the 
decomposition of polynomials and rational functions. 

94. Complex Numbers. A complex number is an expression of the 
form 

a + bi, ( 1 ) 

where a and b are two real numbers, and i is the imaginary unit. Each 
distinct ordered pair of real numbers defines a different complex number. 
That is: 

a + bi *= a' + b'i implies a = a' and b = b\ ( 2 ) 

We include the real numbers by the convention that 

a = a + Oi. (3) 

We also include i itself and its real multiples by putting: 

i = li = 0 + li and bi = 0 + bi. (4) 

95. Operations on Complex Numbers. We define addition for com¬ 
plex numbers by the law: 

(a + bi) + ( a' + b'i) = (a + a f ) + (b + b f )i y (5) 

and multiplication by the law: 

(a + U){a f + b'i) - (aa' - bb') + (ah' + a'b)i. (6) 

The inverse operations of subtraction and division are defined by 

(a + bi) — (o' + b'i) - (a - a') + (b - b')i, (7) 
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of -f- b f i oo f -f* bb f db' — o f b . 
a + bi a 2 + b 2 a 2 + b 2 l ' 


These laws are easily remembered and practically applied by using 
the ordinary rules for real quantities, together with the special relation 

i 2 =-1, (9) 


which follows from equations (4) and (6). The definitions given are 
consistent with the other laws of algebra, such as the commutative, 
associative, and distributive laws for multiplication and addition stated 
in section 2. In practice, we obtain the result of equation (8) by multi¬ 
plying numerator and denominator by a — bi. Since the commutative 
law holds, it is immaterial whether we write a + bi or a + ib. 

96. Geometric Representation. We may match up the points in a 
plane with complex numbers by associating the point with Cartesian 
coordinates (x,y) with the complex number x + iy. It follows from 
equation (2) and the discussion of section 13 that there is one point for 
each complex number, and one complex number for each point. It is 
convenient to use a single letter z to denote the complex number x + iy, 



Fxa. 12. 


and to speak of the point z when referring to 
(x,y). 

Each point ( x,y ) determines a vector drawn 
from the origin to the point, whose components 
are x and y. We may regard this vector, or any 
other vector with the same components, as a geo¬ 
metric representation of the complex number z. 
Thus, if ( p,q) is any point, the vector from it to 
(;p + x,q + y) represents z. We refer to any such 
vector as a vector z. This leads us to denote the 
relation of x and y to z by calling x the real com¬ 


ponent of z, and y the imaginary component of z. We write: 


x =* R(z) and y = I (z) when z = x + iy — R(z) + il (z). (10) 


The vector representing the sum of two complex numbers z i + z 2 may 
be obtained by adding the vectors zj and z 2 in accordance with the 
parallelogram law. 

The geometric interpretation of the product of two complex numbers 
ziz 2 is simplified if we introduce the polar coordinates of the points 
■* («h,yi) and z 2 *» (x 2 ,y 2 ) as defined in section 61. We have: 

»i «■ ri (cos Oi -f i sin $i) and z 2 = r 2 (cos 0 2 + i sin 0 2 ). (11) 
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The product of the factors involving 0 t and 0 2 is: 

(cos 0i cos 02 — sin sin 0 2 ) + i (sin 0i cos 0 2 + cos 0i sin 0 2 ) 

= cos (0i + 0 2 ) 4** i sin (0i + @ 2)7 (12) 

in view of the addition theorems for the sine and cosine. Thus 

Z 1 Z 2 = 7 * 17*2 [cos (0i + 0 2 ) + i sin (0i + 0 2 )], (13) 

so that 

r = rir 2 and 0 = 0i + 0 2 (14) 

give a possible choice of polar coordinates for z = ziz 2 . If we plot the 
origin 0 = (0,0) and the unit point 1 = (1,0), and construct the tri¬ 
angle with vertices 0, 1, z x and that with vertices 0, z 2 , 2 , we may show 
from equation (14) that these triangles are similar since they have two 
sides proportional and the included angles equal. A geometric con¬ 
struction for the point or vector representing the product z = Zi2 2 may 
be deduced from this fact. 

Whenever 

z = r (cos 0 + i sin 0), (15) 

so that r and 0 are polar coordinates of the point 2 , we call r the absolute 
value or modulus of 2 , and 0 the argument or amplitude. We write: 

r — \z\ and 0 = arg 2 . (16) 

The notation \z\ is consistent with |x| to denote the numerical value of a 
real number z, since 

\z\ = Vx 2 + y 2 (17) 

reduces to Vx 2 , or the numerical value of x, when y = 0 and z is the real 
number x. 

We recall from section 61 that \z\ is uniquely determined by equation 
(17), and that if z 9 * 0, arg 2 is determined to within an integral multiple 
of 2t. If 2 = 0, arg 2 may have any value. 

It follows from equation (13) that 

M2! = N W- ( 18 ) 

This shows that a product can not be zero unless one of the factors is 
zero. 

97. Conjugate Complex Numbers. If z = x + iy, the complex 
number 

(19) 


I = x — iy, 
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is called the conjugate complex number to z. We note that z is the con¬ 
jugate of 2, so that the relationship of a number to its conjugate is 
reciprocal. We note that 

12(2) = i2(z) and 7(2) = —7(z). (20) 

Also |z| = |2|, and |z| = (21) 

while —arg 2 is a possible value of arg 2. Geometrically the point 2 is 
the reflection of the point 2 in the x, or real axis. That is, the point 2 is 
so situated that the axis is the perpendicular bisector of the line joining 
the two points 2 and 2. 

Suppose we start with two complex numbers z and z', and combine 
them by any one of the four fundamental operations to obtain a new 
complex number w. If we now start with the conjugates of these 
numbers, 2 and l', and use the same operation, we shall obtain as a result 
the number w, conjugate to w. This follows from the rules given in 
section 95, and may be checked by the geometric interpretation. 

We note that the sum and product of two conjugate complex numbers 
are both real numbers. 

98. Inequalities for Absolute Values. We shall prove that: 

The absolute value of the sum of two complex numbers is less than or equal 
to the sum of their absolute values. 

If 2! = xi + iyi and z 2 = x 2 + iy 2 , we have: 

M « Vx? + yf, \z 2 \ = Vx| + yl (22) 

and |zi + z 2 | 2 = (xi + x 2 ) 2 + (yi + Vz) 2 . (23) 

Consequently, 

IN + K + 2g| 2 =_ _ 

2 Vx? + y\ Vx 2 + yf - 2 x 1 X 2 — tyiVz- (24) 

This will be greater than or equal to zero if 

+ Vi + 2/2 £ Xi *2 + V 1 V 2 , (25) 

or since the left member is positive or zero, if 

x?xf + xfyi + yfx I + yfyz xfxl + 2%ix 2 yiy 2 + y\yz> 

which may be written 

(xm - Vix 2 ) 2 £ 0. (26) 

Knee the left member is the square of a real number, this last 
inequality always holds, and this proves that 

flz.l + Izall 2 & Izi + 2aI 2 . 


(27) 
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or 

M + N £ |*i + *al, (28) 


since both members of this inequality are non-negative. This proves 
the theorem. 

From the form of relation (26), we see that the equality can only 
occur if 


X1V2 - Vix 2 = 


xi 

2/i 



(29) 


This is the condition that the numbers Xi,y x are proportional to the 
numbers #2 > 2/2 since it implies either 

x% x*> 

X\ » 0, yi = 0; x 2 « 0, y 2 = 0; y l » 0, y 2 = 0 or — = —* (30) 

2/i 2/2 


In the geometric representation, the sides of the triangle with vertices 
at 0, z\ and Z\ + z 2 may be considered as 
vectors representing z u z 2 and z x + z 2 . 

The corresponding absolute values are 
the lengths of the sides of the triangle, 

and the relation (28) states that two sides _ 

have a sum greater than the third side. 

The equality may occur if the triangle 
degenerates to one with all three vertices 

in the same line, or with zero area, in which case equation (29) holds. 
The relation 

l*i - *al ^ |M - kali (31) 

follows from 

l*i ~ *s| + kal S N, (32) 



«!+** 


if \zi | ^ |z 2 |, and from this by interchanging z\ and z 2 if |zi| < |z 2 |. 
Here, again, we can only have the equality if the points representing 0, 
z i, and z 2 are collinear. 

By mathematical induction based on the relation (28), we may prove 
that for any integer n, 


z m ^ 


i-i 



(33) 


with strict inequality unless the points representing z* and the origin 
are c ollinear . The relation (33) corresponds to the geometric fact that 
a straight line segment joining two points is shorter than a broken line 
joining the same two points. 
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99. Limits. If x t and y t are real variables approaching limits in the 
sense of section 17, we say that the complex variable z< = x t + iyt 
approaches (lim x t ) + t (lim y t ) as a limit. That is: 

For a complex variable, tt — xt + iyt whose values are determined by a 
continuous or discrete sequence of real numbers t, we define: 



lim Zt = Z — X + iY, 

(34) 

if, and only if, 

lim x t = X and lim yt = F. 

(35) 

These relations imply that: 


lim ( X — x t ) ~ 0 and lim (F — y t ) = 0. 

(36) 

But, 

Z - z t = (X - x t ) + i(Y - y t ) 

(37) 

and 

1 Z - Zt\ = V(X - Xt) 2 + (F - y t ) 2 , 

(38) 

so that: 

lim (Z — z t ) — 0, 

(39) 

and 

lim | Z — z t \ = 0. 

(40) 


From equation (38) we deduce that: 

0 g |X — x t \ [Z — z t \ and 0 ^ JF — y t \ g \Z — z t |. (41) 

From these relations we see that the equation (40) implies equation (36) 
and hence equation (35) and (34). That is: 

A necessary and sufficient condition for the complex variable z t to approach 
Z as a limit is that lim J Z — z t | = 0. 

This reduces the problem of determining whether a complex variable 
depending on a real variable approaches a limit to that of determining 
whether a real variable approaches zero. Since \Z — z t \ is the distance 
between the fixed point Z and the variable point z t , the condition has a 
simple geometric meaning. 

The Cauchy convergence criterion of section 26 applies to complex 
variables. We shall prove that: 

A necessary and sufficient condition for z t to approach a limit is that for 
any positive quantity e, there is some point in the sequence of values of t,t, 
such ihat the absolute value of the difference of any two values of z t) each 
with t beyond i„ is less than «. 

W<r first note that if z\ - x v + iyi and z 2 = *2 + W 2 are any two 
complex numbers, we have: 

O < hu — r.A < lz» — Zit and 0 S \v-t — V\\ ^ \z 2 — *i|, (42) 
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analogous to the relation (41). Consequently, 
if |*2 ~ *il < «, 

1*2 - *i| < e and \y 2 — yi\ < «. (43) 

Thus, if the condition of the theorem is satisfied, for z t = x t + Wt, by 
the Cauchy convergence criterion for the real sequences x t and yt, we 
see that they each approach limits. Thus, by our first definition, z t 
approaches a limit, and the sufficiency of the condition is proved. 

Conversely, if z t approaches a limit Z, equation (40) holds, so that for 
any arbitrary positive quantity, 

\Z — z t \ < ^ * for t beyond t,. (44) 

Thus, if z 9 and z n are any two values of z% with t beyond t t , 

\Z - A <1 “d \Z-z"\<l> (45) 

so that 

W ~ *"l = \{z f - Z) + (Z - z")\ < e. (46) 

This proves that the condition is also necessary, and proves the theorem. 

With only slight modifications the reasoning of section 19 applies to 
complex limits. Hence we may use the results of that section to deter¬ 
mine the behavior of the sum, difference, product, and quotient of two 
complex variables. 

100. Infinity. For a complex variable z h we write 

lim z t — 00 , (47) 

to mean 

lim \z t \ = oo. (48) 

It follows that: 

lim z t = oo if, and only if, lim - = 0. (49) 

When dealing with a variable a t restricted to real values, we shall 
generally continue to use the more explicit notation lim |a<| = °o, since 
for real variables the distinction between lim at = + 00 and lim at = — °o 
is important. 

For complex variables, we generally reduce the study of a variable 
becoming infinite to the study of a variable approaching zero, by using 
equation (49). 

101. Functions. If z = x + iy and w = u + iv are two variable 
complex numbers, there may be a relation between them. As for real 
numbers, we say that w is a function of z for a set of values if for each 
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value of 2 in a certain range one or more values of w are determined. 
We write 

w = f(z) (50) 

to indicate this. 

Since x and y determine z, which in turn determines w, and hence u 
and v, we see that u and v are each functions of x and y, so that: 

w = u(x,y) + iv(x,y), (51) 

and a single function of a complex variable determines two real functions 
of two real variables. Conversely, any two functions of x and y may be 
used in place of u and t’ to determine to as a function of z. 

For the present we shall be interested in a very restricted class of 
functions of a complex variable, those which correspond to the elemen¬ 
tary functions defined in section 69. 

The range of z will usually be some two-dimensional open region as 
defined in section 15, or the corresponding closed region obtained from 
it by adding the boundary points as in section 35. If the functions 
u(x,y) and v(x,y) are each single-valued in the range, there will be just 
one value of w for each value of z, and we say that w is a single-valued 
function of z. 

102. Continuity. Let w = /(z) be a single-valued function of the 
complex variable z — x + iy for values of (x,y) in some two-dimensional 
region. If z ' is any interior point of this region, we say that: 

The function f(z) is continuous at z' if 

lim f(z t )=f(z') (52) 

for every sequence z t such that z t —* z . 

This is analogous to the first definition of section 35 if we restrict 
ourselves to discrete sequences. By reasoning as in that section, we 
may show that if the property holds for discrete sequences, it holds for 
all sequences, and that the definition is equivalent to: 

The function f(z) is continuous at z' if, for every positive number t there 
is o corresponding positive number S t such that 

!/(*)-/<*') I<«, if I*-*'!<«.. (53) 

If we write z' — x' + iy', and Zt = x t + iyt, it follows from the 
definit i on of section 99 that lim z t = z' if, and only if, lim x t — x ' and 
limy* * yf. Also lim/(z<) — f(z') if, and only if, lim u(x t ,yt) * 
u(*V) and lim v{x t ,y t ) * v(x',y'), where/(z) = u(x,y) + iv(x,y). In 
view of these facte, a comparison of the first definition of this section 

-—*a 1L it * -3 **t QR oVtAWO • 
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The Junction f(z) of the complex variable z = x + iy is continuous at 
z = x + iy if, and only if, the two real functions u{x,y) and v(x,y) such 
that w(x + iy) — u(x,y) + iv(x,y) are each continuous at (x',y'). 

103. The Exponential Function. Since the properties 


and 


E(z)E(z') = E(z + z'), (54) 


lim 

*-►0 


Ejz ) - 1 
z 


- 1 , 


(55) 


completely characterize the function E(z) as the exponential function 
when z is restricted to real values, as we saw in section 51, it is natural 
to extend the definition to complex values by attempting to satisfy 
these relations for complex values of z. We shall see that this is possible 
and may be done in only one way. 

Let us first suppose that there is a function satisfying these relations, 
and let us determine its properties on this assumption. 

If z — x + iy, where x and y are real, we have from equation (54), 

E(x + iy) - E(x)E(iy). (56) 

But, if we put z = x in equations (54) and (55) they reduce to the 
equations (130) and (131) of section 51. This shows that we must have 

E{ x) = e*. (57) 

The equations (54) and (55) are then satisfied, since 

eV' = e* +x \ (58) 

and 

lim --- = 1. (59) 

z-~+0 X 

For any particular value of y, E(iy) is a complex number which may 
be expressed in terms of two real numbers: 

E(iy) = C(y) + iS(y), (60) 

so that the real and imaginary components of E (iy) are each real func¬ 
tions of the real variable y. 

If we put z = iy, z' - iy' in equation (54), we have: 

E(iy)E(iy') = E[i(y + j/')], (61) 

or, 

rcAA 4- lC(u') 4- iS(v')] = C(y + y') + iS(y + y f ). (62) 
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This is equivalent to 

C(y + v') = C(y)C{y') - S(y)S(y'), 

S(y + y') = S(y)C(y') + C(y)S(y'), 

in view of equations (6) and (2). 

For z = iy, the condition (55) becomes: 

iv-+o W 

or, if we use equation (60), 

i. L 

v-*o iy 

But, by equation (35), this is equivalent to: 

HmM. 

y 

C(y) - 1 


and 


lim 

2/—►O 


0 . 


V 


From equation (63) we may deduce that 

C(y + h) - C(y) = C(h) - 1 


h h 

Again, from equation (64) we may deduce that 
S(y + h) 


- S(y ) 


8(h) 




(63) 

(64) 


(65) 

( 66 ) 

(67) 

( 68 ) 


(69) 


(70) 


Since h only appears in these two equations in expressions similar to 
those in equations (67) and (68), the right members of these two equa¬ 
tions will approach limi ts as h 0. Hence the left members will 
approach limits, and the functions C(y) and S(y) have derivatives for 
all values of y , given by: 

4-C(y ) - -S(y) and S(y) = C(y). (71) 

ay ay 

Now consider the function 

F(y ) - C 2 (y ) + S 2 (y). (72) 

By iMing equation (71), we find that 

' x F(y) - 2C(y)[- 5(y)) + 2S(y)C%) - 0, (73) 
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so that by a theorem proved in section 75, the function F(y) is a con¬ 
stant. But equations (67) and (68) show that S(y) —* 0 and C(y) —> 1 
as y —> 0. Thus the right member of equation (72) approaches 1, and 
the value of the constant is 1. Hence: 

C 2 (y) + s>(y) = 1. (74) 

Since the equations (64), (63), (74) and (67) only differ from equations 
(224), (225), (226) and (227) of section 57 in having x replaced by y } 
it follows from the theorem of that section that 

C(y) = cos y and S(y) = sin y. (75) 

These functions satisfy equations (63) and (64), which are equivalent 
to equation (61) if equation (60) holds. Hence if we define 

e %v = cos y + i sin y } (76) 

we have: 

eV*' = e iiv+v,) . (77) 


We note that for any function / (y) having a derivative for y = 0, 


lim 
1/—►o 


f(y) ~/(Q) 
y 


/'(o). 


In particular, for the sine and cosine this becomes: 


lim 


sin y 


y -~o y 


1 


and 


cos y — 1 
lim- 

v+o y 


= o. 


(78) 


(79) 


It follows that the functions as defined by equation (75) satisfy the 
equations (67) and (68), which together are equivalent to equation (65) 
if equation (60) holds. Thus we have for the function defined by 
equation (76): 

Jy ~ i e iv — 1 

lim- = 1, or lim-= i. (80) 

o iy v—o y 

In accordance with equation (56) we now define 

e * = e x+iv = e x e' v = e x (cos y + i sin y). (81) 


Its continuity for all values of z follows from the continuity of its real 
and imaginary components by section 102. 

The preceding argument has shown that no other function of z can 
satisfy the two conditions (54) and (55). We must next investigate 
whether the function given by equation (81) itself satisfies these con¬ 
ditions. We have: 

e*e*' = eWV*'' = 


( 82 ) 
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as a consequence of equations (58) and (77). Thus the first condition 
is satisfied. 

Hie second condition is satisfied when z is restricted to real values, in 
view of equation (59). In consequence of this and the fundamental 
definition of a limit, we may write 

e* = 1 + x + hx, where |A| < e, if |x| < $j. (83) 

Similarly, the condition is satisfied when z is restricted to real mul¬ 

tiples of i, in view of equation (80). From this and the property of 
a complex limit expressed in equation (40), we may write 

e' v = 1 + iy + ky, where |fc| < «, if \y\ < J 2 . (84) 

We may deduce from the last two equations that: 

e* — 1 — eV v — 1 = x + iy + hx + ky + (i + hi + k + hk)xy. (85) 

Let us now take 0 < « < 1, determine 5i and 5 2 , and then take 

0 < |z| < 5, where 5 < min(«, $i, 5 2 ), (86) 

the minimum of the three numbers. Then, since 

|*| ^ |z| and |y| g \z\, (87) 

for any complex number z — x + iy, we have: 

|Aj < e, |fc| < t and |i -f hi + k + hk\ < 4, (88) 

so that 

|te + ky + (i + hi + k + hk)xy\ < t|z| + «jzj + 4«|z| <£ 6«jzj. (89) 
It follows from this relation and equation (85) that 

< 6e, if 0 < |z| < S. (90) 

Since « is an arbitrary positive number less than unity, 6« may be 
made arbitrarily small, and this equation is the condition that 

e* — 1 

= 0, or lim- = 1. (91) 

#—►0 z 

Thus the second condition is satisfied, and we have proved that: 

The function of the complex number z = x + iy, 

* «* m e* +iu = e* (cos y + i sin y), (92) 

$ i 

haetiieproperty: 




ev' - «*+*', 


(98) 
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for all complex values of z and z', and the special property 

e* - 1 

lim-— 1. (94) 

2—►O Z 


These two properties uniquely characterize the function . 

104. The Trigonometric Functions, sin z and cos z. The properties 



S(g + z') = S(z)C(z') + C(z)S(z'), 

(95) 


C{z + z') = C(z)C(z') - S(z)S(z’), 

(96) 


C\z) + S 2 (z) = 1, 

(97) 

and 

z—►O Z 

(98) 


completely characterize the functions S(x) and C (x) when z is restricted 
to real values, x. In fact, we showed in section 57 that these properties 
hold if and only if 

S(x) = sin x and C(x) = cos x. (99) 

We shall accordingly use these properties to extend the definition of 
the trigonometric functions to complex values. 

If the four fundamental equations hold for all complex values of z, 
they hold, in particular, for all real values. For these values equation 
(99) holds, and hence 


S( 0) = 0 and C( 0) = 1. 

(100) 

It follows from equation (98) that 


lim S (a) = 0. 

(101) 




Thus the function S(z) is a continuous function of the complex variable z, 
at z — 0. 

Since the equations (96) and (97) imply that 

(7(2*) - 1 - 2S 2 (z), (102) 


it follows that the function C(z) is a continuous function of the complex 
variable z, at z — 0. Hence, 

lim [<?(*) + 1] - (7(0) + 1-2, 


*-►0 


and from equations (97) and (98) we may conclude that: 


lim 


C(z) - 1 


■S(z) S(z) 


C(z) + 1 a 


- 0 . 


a 


(103) 



164 


COMPLEX NUMBERS 


{Chap. V 


The similarity in form of our equations with those used in the last 
section to determine E(iy) suggests that we introduce a function E(iz), 
defined by the equation: 

E{iz) = C(z) + iS(z). (104) 

Then, since 

[C(z) + tS(z)] [C(z') + iS(z')] = C(z + z') + iS(z + z') (105) 
is a consequence of equations (95) and (96), we have 

E(iz)E(iz ') = E[i(z + *')]• (106) 


We also note from equation (104) that: 

E(iz) - 1 1 C(z) - 1 


+ 


S(z) 


IZ l z z 

It follows from this, equation (98) and equation (103) that: 

E(iz ) - 1 , 


If we write 


lim 

z -+0 


Z = 


IZ 


-iw, W = IZ, 


(107) 


(108) 

(109) 


the function E{w) is defined for all complex values of w by equations 
(109) and (104). In terms of w, equation (106) is 

E(w)E(w') = E(w + w'). (110) 


Also, since z —»0 when w—*0, equation (108) may be written: 


lim 

w-»0 


EM - 1 
w 


= 1. 


(Ill) 


As these equations are identical in form with equations (54) and (55) 
of the last section, it follows that they will be satisfied if, and only if: 

E(w) m e v , (112) 

and 

C(z) + iS(z ) - E(iz) = e“. (113) 

This equation does not immediately determine C(z) and S(z), since 
they are not necessarily the real and imaginary components of the 
complex number on the right when z is not a real number. 

However, we have: 

1 1 C(«) - iS(z) 


e 


(114) 
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It follows from this and equation (97) that: 

C(z) - iS(z) = C*. 

We may now conclude from equations (113) and (115) that: 




e w + e~” 


and S(z) = 


2 i 


(115) 

( 116 ) 


It is a direct algebraic consequence of the fundamental property of the 
exponential function expressed in equation (93) that the functions 
defined by equation (116) satisfy the relations (95), (96), and (97), if, 
for the last, we recall that e° = 1. That these functions satisfy the 
fourth condition, equation (98), is a consequence of the second property 
of the exponential function given in equation (94). 

We use the equations (116) as the definition of cos z and sin z for 
complex values of the variable. If we put: 

z — x + iy, iz — ~~y + ix y ~-iz = y — ix y (117) 
we have from equation (92): 

e xz = e ~v (cos x + i sin x), e~ iz = e v (cos x — i sin x). (118) 

These equations enable us to define sin z and cos z directly in terms of 
trigonometric functions of x and hyperbolic functions of y , as defined in 
section 68. We have: 


sin z = 

cos z = 


e iz _ e ~it 

2i 
e iz + 

2 


sin x cosh y + i cos x sinh y . 
cos x cosh y — i sin x sinh y. 


(119) 

( 120 ) 


The discussion of this section has proved that: 

The functions of the complex number z = x + iy defined by equations 
(119) and (120) have the properties: 

sin (z + z') = sin z cos z* + cos z sin z\ (121) 

cos (z + z) = cos z cos z f — sin z sin z' } (122) 

cos 2 z + sin 2 z=l, (123) 


for aU complex values of 2, and also have the special property: 

sin 2 


lim 

*—►O 2 


1 . 


(124) 


These four properties uniquely characterize the functions . 
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106. Properties of the Trigonometric Functions. All the identities 
involving the functions sin z and cos z derivable as consequences of the 
equations (121), (122), and (123), mentioned in section 68 for real 
values of the variable, hold when z is complex, since the algebraic proces¬ 
ses by which they were proved for real values are still valid. 

However, a direct proof of any such identity for complex values of z 
is always possible by using the formulas 

e iz — e~ iz e iz + €~ iz 

sin z = ——- and cos z = --- (125) 


to reduce the trigonometric identity to an identity involving exponentials 
which is an algebraic consequence of equation (93). Such a proof is 
often simpler than a proof involving real quantities only. 

It is often convenient to use also the formulas 

e lz = cos z + i sin z and e~ lz = cos z — i sin z. (126) 


For example, from 

e inz _ e~ inz 

sin nz =-—- 

2 i 


(cos z + i sin z) n — (cos z — i sin z) n 
2 i 


(127) 


we easily derive a formula expressing sin nz as a polynomial in sin z 
and cos z> with real coefficients. Similarly, any polynomial involving 
sines and cosines of multiples of z may be expressed as a polynomial in 
sin z and cos z. 

Conversely, from 


sin n z cos™ 



- e- iz \ n / e iz + e" iz \ m 

2 i ) V 2 ) 


m-fn m -fn 

= ]£ Ake kii = £ (a* cos kz + 6* sin kz), 

k = —m —n k**0 


(128) 


we may express any polynomial in sin z and cos z as a linear combina¬ 
tion of sines and cosines of multiples of z. The final coefficients a* and 
bk will be real. For the values of the expressions in parentheses are 
unchanged if we replace i by — i, which shows that must be the 
complex number conjugate to Ak- Thus, if the original polynomial has 
real coefficients, the coefficients in the linear combination will also be real. 

A b in the case of real quantities, the remaining four trigonometric 
functions are defined by the equations: 

sin z cos z 

tan z =- 1 cot z — ——> (129) 

cos z sm z 


sec z 


1 1 
—» esc z = -— • 


(130) 
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Thus their properties may be deduced from those of the sine and cosine. 
It follows from the preceding discussion that all the algebraic identities 
involving any of the six trigonometric functions which hold for real 
values of the variable are valid when the variable is complex. 

We note that inequalities derived for real values do not in general 
continue to be true. For example, when sin x and cos x are real, it 
follows from cos 2 x + sin 2 x = 1, that (sin x\ g 1, but we cannot draw 
this conclusion, and the inequality does not necessarily hold, when the 
values are complex. 

106. Hyperbolic Functions. The definitions of the hyperbolic func¬ 
tions given in section 68 may be used for complex values of the variable, 
and give: 

- e—. . e z + e* 

sinh z = -> cosh z - - 

2 2 

It follows from this and equation (92) that if z = x + iy, 
sinh z — sinh x cos y + i cosh x sin y f 
cosh z = cosh x cos y + i sinh x sin y. 


(131) 

(132) 

(133) 


The four other functions are defined as before by: 


_ sinh z 
tanh z = —;—» 
cosh z 


eoth z — 


cosh z 
sinh z 


seeh z = 


1 


cosh z 


csch z = 


1 


sinh z 


(134) 

(135) 


A comparison of equations (131) and (125) shows that: 

sinh iz = i sin z and cosh iz = cos z , 

and also that 

sin iz = i sinh z and cos iz = cosh z . 


(136) 

(137) 


These and the relations of similar character derived from them combined 
with equations (134) and (135) are often convenient in deriving for¬ 
mulas for hyperbolic functions from the more familiar formulas for the 
trigonometric functions. For example: 

cosh (z + z f ) ~ cos (iz + iz r ) = cos iz cos iz r — sin iz sin iz* 

= cosh z cosh z f + sinh z sinh z\ (138) 


Identities in the hyperbolic functions may also be derived directly 
from equations (131) combined with 

e 9 = cosh z + sinh z and e~ z = cosh z — sinh z , (139) 

in a manner analogous to that illustrated for the trigonometric functions. 
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107. The Logarithmic Function. For real values of the variables, the 
relations 

w = log z and 2 = e a (140) 

are equivalent. If z = x + iy i sa given complex number, and the 
complex number w «■> u + iv satisfies this last equation, then 

x + iy — e“ (cos v + i sin v). (141) 

This implies that 

x = e“ cos v, y = e“ sin v (142) 

so that 

i 2 + y 2 - e 2 “ and e u = |z(, (143) 

since e“ is positive for all real values of u. 

If we assume that 2 ^ 0 , this determines u as 

u = log \z\ (144) 

and when combined with equation (142) leads to 

X V 

cos t; = > sin 1 ; = —: (145) 

1*1 i*i 

which determine v to within an integral multiple of 2ir as we showed in 
section 61. In fact, 

v = arg z, (146) 

as we might have noted directly by comparing equation (141) with 
equation (15), and identifying e u and v with the polar coordinates 
r = \z\ and 6 = arg z. 

Since equation (141) follows from equations (144) and (146), we are 
led to define the logarithm of a complex number z by 

log 2 = log |z) + i arg z = log r + id. (147) 

This function is many valued, since arg z is not uniquely determined. 
For any real constant a, there is just one possible value of arg z or 0 in 
the range 

a £ 6 < a + 2ir. (148) 

These values constitute a single-valued branch of the function arg z 
corresponding to a. The values of the logarithm satisfying the restric¬ 
tion (148) constitute a single-valued branch of the logarithmic function 
correqi ^ B n g to a. Thus: 

branch of the logarithmic function corresponding to a is defined by 

■ft , fi 

, ~ f 1 * a < flTff z < a + 2w, (149) 
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The function is uniquely defined for any value of z * 0, 

and if w = log z, z = e » fl50) 

If 0 is the value of arg 2 for any one branch and if 0' is the value far the 
same z for any other branch, then 9 — B r ~ 2 /ct, where k is zero or a 
positive or negative integer. 

While log z is not defined for 2 = 0 , we may write 

lira log 2 = oo, ( 151 ) 

2—►O 

in accordance with the convention of section 100, since 

flog z\ log \z\, and lim log \z\ = — 00. (152) 

z —►O 


We note that for any one branch, if z 0 and Ma, the function 0, 
and hence the function log z , is continuous. If we start with a value of 
z 5 ^ 0, and then select a value of a not a possible value of arg z for this 
value, we shall obtain a branch of log z continuous for the value in 
question. 

Thus, if z varies continuously, without passing through zero we may 
change the branch in such a way that log z varies continuously. How¬ 
ever, if z traverses a circle with center at the origin, the final value of 
log z will differ from the initial value. For any range of z which excludes 
some radius drawn out from the origin, i.e., such that for some value of a 
none of the values 

z = r cos a + ir sin a, 0 g r (153) 


belong to the region, we may find a branch of the function w — log z 
which is single-valued and continuous. We shall usually consider 
z restricted to such a range. 

The properties used to characterize the logarithmic function for real 
values in section 50 apply with certain reservations to the function 
defined by equation (149). If w = log z and w r = log z', we have 

z = e™, z f - e w ', zz f = . (154) 

Thus, if & and z f are both distinct from zero, log z + log z f or w + w* is, 
for some branch, log (zz'). Thus we may write either 

log z + log z f = log (zz') for suitable branches, (155) 


log z + log z' ** log zz' + 2 kri, 


where we may take all three logarithms for the same branch, or for any 
—1 -wa naa a ciii+oKlp vflhiA of the intecrral multiple fc. 
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That k is not necessarily zero when we use the same branch in all 
cases may be seen by taking 0 5* 6 < 2x for all the logarithms, and 
0 — Zir/2 for log z and log z . 

The special relation (112) of section 50 can only hold for complex 
values if log (1 -f z) —> 0 as z —> 0. Accordingly, we consider a branch 
with —2 jt < a < 0. We put: 

w — log (1 + z), z = e w — 1. (157) 


For the branch considered log 1 = 0 and the logarithm is continuous 
in a region including 1, so that w —»0 when z —»0. Consequently we 
have: 


lim 

z —+0 


log (1 + z) 
z 


= lim - 

v >—*0 6 


W 


-l 


= i, 


(158) 


by equation (94). Thus the special relation holds for any branch with 
—2ir < a < 0, that is any branch which makes log z continuous for all 
real and positive values of z, and is such that for these values log z is 
identical with the function log x of section 50. 

108. Power Functions. For any complex value of A 0, and any 
complex value of B, we write: 

a b = e aiogA (159) 


which determines a value of the power for each choice of a particular 
branch of the function log z. 

If a is the value of the argument of A for any one branch, for any 
other branch the value may be written a + 2 kir, where k is zero or a 
positive or negative integer. Thus, if a is the absolute value of A, we 
shall have for any branch: 

log A = log a + i(a + 2kv). (160) 

Consequently, 

j^B __ gBflogo -H(<* + 2k*)} __ gB(loga -\r ia)^2Bkri^ (161) 


The value of the power for a branch with k 0 will only agree with 
that for k = 0 if 

e 25 *" - 1 and 2 Bkid = log 1, (162) 

for some branch of the logarithm. But, since log 1 is 0 for one branch, 
for any other branch it will be an integral multiple of 2xi, say 2 K*i, 
and We must have: 

1 2 Bkvi ** 2Kiri and Bk = K or B = (163) 


1 *l» 


/**m\ 
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When B is not real and rational, each different value of k in equations 
(160) and (161) will give a different value to A B , and this expression is 
infinitely many-valued. By restricting z to a region in which some 
branch of the logarithmic function is single-valued and continuous, we 
may obtain a single-valued and continuous branch of the function z B 
for all values of B. 

For the function A*, since 

A * gZlog A g*(log a +ia + 2kiri) (164) 

each choice of k determines a separate function, single-valued and con¬ 
tinuous for all complex values of z. For real and positive values of 
Ay A = py one choice makes 

p z = e* log p . (165) 

When p is real and positive, unless the context indicates otherwise, we 
take this last equation as the definition of p z . This convention justifies 
our use of e* for the function defined in section 103, instead of for the 
infinitely many-valued function found by putting A = e in equation 
(164). 

The possibility of the second interpretation is occasionally convenient, 
for example in using a particular branch of z 8 , and evaluating this 
function for z = p, or z = e. 

Let us return to the consideration of A B when B is real and rational. 
If B = 0, we have for all A 0, A 0 = 1, regardless of the value of k in 
equation (161). For an integral value of B, Bk is an integer for all 
values of fr, and the last exponential written in equation (161) is unity. 

In fact, the value uniquely determined by putting B = n, a positive 
integer in equation (159) or (161), is the same as that obtained by 
repeated multiplication by A, as we see from equation (93). We also 
see from this equation that the value obtained by putting B — —n is 
the reciprocal of that for B = n. 

For py a positive or negative integer, and a particular determination 

Of lOg Ay 

A Bp = e Bp log a = ( c siog^)P « (166) 

so that a rational power, p/q is uniquely determined from the value of 
the power 1 /q, and we may take q positive. 

For B = i/q } with q a positive integer, the equation (163) will be 
satisfied if k = gK } in which case k is an integral multiple of q . Thus, 
any two values of the logarithm which differ by 2kin will give the same 
value of A B if k is an integral multiple of q. If we take k * 0,1, 2, • * *, 
q — 1, in equation (161) we obtain q distinct values. Since any other 
integer differs from one of these by a multiple of q, the equation (159) 
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gives q possible values to A l/q . Each of these has its gth power equal to 
A, and these are the q roots of the equation z® — A — 0. We sometimes 

write Va in place of A 1/8 or Va for A 1/2 . For A real and positive, 
one of these roots is real and positive. When q is even, there is a second 
real root which is negative. Also, when A is real and negative, and q 
is odd, there is a negative real root. For q — 2, and any complex value 
of A, the two square roots differ by a factor of — 1. 

109. Inverse Functions. By solving quadratic equations, and tak¬ 
ing logarithms, we may express all the inverse trigonometric functions 
in terms of square roots and logarithms, so that these functions are single 
valued in suitably restricted regions. We have: 

sin -1 z = esc -1 - = — i log (iz + Vl — z 2 ) (167) 

z 

cos -1 z = sec -1 - = —i log (z + Vz 2 — 1) (168) 

z 

i i 1 %, 1 1 %z .. _ _. 

tan 1 z = cot 1 - = - log —. • (169) 

z 2 1 + iz 

Similarly we find for the inverse hyperbolic functions: 

sinh -1 z = csch -1 - = log (z + Vl -f- z 2 ) (170) 

z 

cosh -1 z = sech -1 - = log (z + Vz 2 — 1) (171) 

z 

tanh -1 z = coth -1 - = ^ log ’ (172) 

z 2 1 z 


110. Derivatives. If w = f(z) and Aw and Az denote correspond¬ 
ing complex increments of w and z, we define the derivative 


/(*) 


dw Aw 

= — = Inn — = lim 
dz Ai-+o A z h—+o 


f(z + h) -/(z) 
-----, 


(173) 


in case the last limit exists and has the same value for all sequences of 
complex values of h or Az distinct from zero, and approaching zero as a 
limit. 

As in the case of real variables, it follows from the definition that: 





( 174 ) 


I < u + v > 


dU dV 
dz + dz' 


(175) 
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| (UV) = Uj^+V^, 


dU dV 

7 3— — 
dz dz 


m- 


Also, the reasoning used in section 65 shows that, if w = f(U) and 
U = g(z), and for U 0 = g(z 0 ), the function f(U) has a finite derivative 
at Uo) while g(z) has a finite derivative at z 0 , then the function 

™=fW)] = F{z), (178) 

has a derivative, at z 0 given by 


dw dw dU 
dz dU dz 


or F'(z 0 ) =f'(U 0 )g'(zo). 


It also follows directly from the definition of a derivative that 
dk dz 

— = 0, and — — 1, (180) 

dz dz 

so that polynomials and rational functions of a complex variable may be 
differentiated by the rules derived in section 63. 

111. Special Functions. For the function e*, we have: 


in view of equations (93) and (94). This proves that: 


Consider next the function w = log z, at a point z interior to a region 
in which the branch used is continuous and single-valued. Then 

„ . log (z + Az) - log 2 Aw 

z^e, and ^ gW+Aw_ * (183) 

As e w is single-valued, Au> ^ 0 if Az ^ 0, and since w = log z is con¬ 
tinuous at 2 , Aw —* 0 when Az —> 0. But 

w+Aw _ f w j 


It follows from the last two equations that: 



Again, from equations (125), (182) and the preceding section we find 
for the functions sin z and cos z that: 

d d 

~ (sin z) = cos z and (cos z) = —sin z. (186) 

dz dz 

Thus all the formulas for differentiating trigonometric and inverse 
trigonometric functions for real values apply to complex values, with 
suitable restrictions on the regions and branches for the inverse functions. 

Similarly, in consequence of equation (131) we find: 

d . d 

(sinh z) = cosh z and 7 - (cosh z) = sinh z } (187) 
dz dz 

and the formulas for differentiating hyperbolic functions and their 
inverse functions for real values may be extended to the case where the 
variable is complex. 

112, Elementary Functions. The function sin z is expressed in 
terms of the exponential function by equation (125). The power func¬ 
tion A B is expressed in terms of the exponential and logarithmic function 
by equation (159). The function sin -1 z may be written 

sin --1 z — —i log [iz + e 1 log(1_z2) ], (188) 

in view of equations (167) and (159). Consequently, when consider¬ 
ing complex values of the variable, we need to consider only the func¬ 
tions e z and log z as basic elementary functions. Thus we may define: 

An elementary function of the complex variable z is a function which 
can be explicitly represented in terms of constants and the independent 
variable z , by means of the four fundamental operations and the exponen¬ 
tial and logarithmic functions, using, at most, a finite number of opera¬ 
tions and, at most, a finite number of basic functions. For any choice 
of branches of the logarithmic functions involved, if the explicit repre¬ 
sentation of an elementary function leads to a finite and determinate 
value for values of z in some two-dimensional region, we may find two- 
dimensional regions in which the representation leads to a single-valued 
and continuous function. We shall speak of such a function with its 
associated region as the single-valued branch of an elementary function, 
or simply as a single-valued elementary function. 

A comparison of this definition with that given in section 09 shows 
that, at least in a limited range of the variable, every elementary func¬ 
tion as there defined may be obtained from a single-valued elementary 
function by further restricting z to real values. The principles of the 
last two, Sections enable us to find the derivative of a single-valued 
elementary function for any value z interior to the region associated with 
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the single-valued branch considered. For any region composed entirely 
of such interior points, the derivative is again a single-valued elementary 
function. The rules for differentiation are formally identical with the 
familiar rules for real functions. 

113. The Fundamental Theorem of Algebra. The fundamental 

theorem of algebra asserts that if P(z ) is a polynomial in z which is not 
identically a constant ) then the equation 

P{z ) = 0 (189) 

is satisfied by some complex number. Since |P(z)| is always positive or 
zero, any root of P(z ) = 0 makes this a minimum, and our proof will be 
based on this minimum property. 

We shall first prove that, if \P(z)\ takes on its minimum value m for a 
region R at z 0) an interior point of R, then m = 0 . 

Let us assume that the minimum m, taken on at zq is not zero. If 

P(z) = a 0 + a x z + • • ■ + a n z n , a n ^ 0 , (190) 

n, the highest power of z present with non-zero coefficient is called the 
degree of the polynomial. Since P{z) is not a constant, n is at least 
unity. If we write z = z 0 + h } we have 

P(z) = P(z 0 + h) = Q(h). (191) 

Here Q(h) is a polynomial of the nth degree in h f as we see on multiply¬ 
ing out the powers and combining the terms. The degree is n since the 
only term in h n is a n h n and since no higher power occurs. Put 

Q(h) = Cq + C\h + * • * + c n h n , c n 9 ^ 0. (192) 

Let c r = Ci if ci 0 , and otherwise, the first coefficient following c 0 
which is not zero. It follows from our assumption that 

Co 5 ^ 0 , since |c 0 | = |Q( 0 )| = |P(z 0 )| = w. (193) 

Thus there is a complex number ~-c r /c 0 which is not zero, and, if one 
value of its logarithm is 6 + iB , we may write: 

— — = e h e iB and c r = —c 0 e b e lB . (194) 

Co 

Let p be a positive real number, and take 

iB 

h\ = pe r so that h\ = p r e^ D . (195) 

Then the first two non-zero terms of Q,(hi) may be written: 
c 0 + c r h\ = Co — c 0 cV, 


(196) 
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and the absolute value of these terms will be 

M |1 - «Vl, (197) 

whioh will be less than |c 0 | if p r e b < 1 , 

b 

or if p<e~~ T . (198) 

Let C be an upper bound for |c*|. Then the terms of Q(hi) following 
Cr are less than n in number and each term contains a power of hi greater 
than r. Hence if we take 


|Ai| < 1, that is, p < 1, (199) 

we shall have for each of these terms: 

|cftM| ^ c V k ^ Cp T+1 , fc > r, (200) 

and the absolute value of the sum of these terms will not exceed: 


Cnp' 


vH-1 


or 


|c 0 |eV 


if p < 


|co|e 6 
2 Cn 


Under these conditions, we shall have 

IQ (Ml ^ |co|(i - «V) 


\c 0 \e b p 


b^r 


* 4 - ¥) 


< |c 0 |. 


( 201 ) 


( 202 ) 


Let \is now take p so as to satisfy the relations (198), (199), (201), and 
also so small that zi = z 0 + hi is in R, which we may do since Zo is an 
interior point of the region R. Then 


P{z\) = Q(hi) and |P(zi)| < jc 0 | or m, (203) 

by equations (202) and (193). Since m is the minimum value of 
|P(z)| for the region R, this relation cannot hold, so that the assumption 
that m^0 leads to a contradiction. This proves that m must equal 0, 
as stated. 

We shall now show that |P(z)| must take on its minimum value at an 
interior point of a circle with center at the origin and radius q, if q is 
sufficiently large. On such a circle, |z| = q, and the numerical value of 
the term of highest degree in P(z), equation (190), is: 

' k ' l<M"| = Kl«”. 


(204) 
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Let A be an upper bound for all the |a*.|. Then the remaining terms 
of P(z) are n in number, and each term contains at most the (n — l)st 
power of z. Hence if we take 


? > 1 ) 

we shall have for each of these terms 

|a fc z*| g A<f g Aq n -\ k < n, 

and the absolute value of the sum of these terms will not exceed: 


Anq 


or it 

2 * |a„| 

With these conditions, we shall have on the circle, 

w«)i s i-.hr -h=!£ a MI. 


(205) 

(206) 

(207) 


(208) 


This will exceed the value of |P(z)| at the center of the circle, 
|P( 0 )| = Idol, 

if ^->KI or 7 > (^~) • (209) 

Let us now take a value of q so large that the relations (205), (207) 
and (209) are all satisfied. Then 

|P(2)I > |P(0)|, if |z| = q. ( 210 ) 

This shows that |P(z)j cannot take on a minimum value for the region 
R q consisting of the interior and boundary points of the circle |z| = q 
at any point of the boundary. 

Let us now introduce the real coordinates ( x,y ) of the point z. Then 
z = x + iy, and P(z) = u(x,y) + iv(x,y), where u and i> are each 
polynomials in x and y with real coefficients. Hence 

u 2 + v 2 ^ 0 , and |P(z)| = Vu a + v 2 ( 211 ) 

is a continuous function of the two real variables x,y by section 35 and 
section 39, for all values. 

In particular, the function |P(z)| is continuous in the closed region 
R g consisting of the points for which 

|z| g j or x 2 + y 2 ^ q 2 . ( 212 ) 

Thus, by a theorem of section 35, there is some point zo of this clqsed 
region for which |P(z)| takes on its minimum value. 
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As we have already deduced from equation (210) that z 0 is not a point 
of the bounding circle |z| = q, it must be an interior point. This proves 
our second contention. 

Let us now apply the first result to the region R a and the minimum 
value of |P(z)|, m = |P(z 0 )|. This shows that 

|P(*o)| = m — 0, and P(z 0 ) = 0. (213) 


Thus we have shown the existence of a root of the equation (189) and 
proved the fundamental theorem of algebra. 

114. Polynomials. If A (z) is any polynomial of degree m, and B(z) 
is any polynomial of degree n, where m Ss n > 0, the algebraic process 
of long division enables us to find a quotient polynomial Q(z), of degree 
m — n, and a remainder polynomial R{z) whose degree is lower than 
that of B(z), such that: 

A(z) = B(z)Q(z) + R(z), (214) 


or 


Mz) 
B(z ) 


= Q(z) + 


R(Z) 
B (z) * 


(215) 


These are identities, in the sense that the right side may be simplified 
to an expression of the same form, with the same coefficients, as the left 
side. Thus, in the first equation we may put z equal to any value, and 
in the second we may put z equal to any value for which B (z) ^ 0. 

Now let us apply the identity (214) to the division of a polynomial 
P(z) by z — b, where b is any complex number. Then the remainder 
will be a constant, and we shall have: 

P(z) = Q(z)(z — b) + c. (216) 

If we put z = b in this identity, we find: 

P(b) = c, and hence P(z) = Q(z)(z - b) + P(6). (217) 

Thus the remainder is P(b) and will be zero if, and only if, P(b) — 0, 
that is, if 6 is a root of the polynomial. 

We proved in the last section that every polynomial of positive degree 
has a root. Let us start with P(z), any polynomial of degree n, » 2s 1, 
and let hi be a root. Then we may write 

P(z) = Q(z)(z-5i), (218) 

where Q(z) is of the (n — l)st degree. If we treat Q(z) in the same way 
we treated P(z) and continue with the new quotient, we shall find after 
n ^#$6 a quotient which is a constant, and thus have: 

PW«i(z-W(*-W(*-W-"(*-W, k * Q - ( 210 ) 
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Several of the bj may be equal. If there are r and no more roots equal 
to &i, bi is said to be of multiplicity r, or a multiple root of order r. In 
this case we see from equation (219) that 

P(z) = (z — b x ) r Q(z), where Q(&i) 0. (220) 


These facts may be summarized in the statement: 

If we count a multiple root of order r, r times, every polynomial of the 
nth degree , n ^ 1, has n roots b 3 . The polynomial may be written as the 
product of a constant and n first degree factors of the form z — bj. 

The bj are uniquely determined by the polynomial, since no value of z 
distinct from the n b 3 can make the product (219) vanish. The multi¬ 
plicities are also determined. For, from equation (220): 


P(z) 

lim --— = Q(bi) ^ 0, and 

z-+bx \Z — b i) 


P{z) 


lim t J, Y 

z—+bx (z b i) 


r—1 


= 0 , 


( 221 ) 


and these properties define the multiplicity of b x . 

115. Rational Functions. A rational function is one obtained from z 
and a finite set of constants by a finite number of additions, multiplica¬ 
tions, and divisions. Such a function may always be written as the 
quotient of two polynomials, by operations which are reversible except 
for those values of z for which certain polynomials are zero. If the two 
polynomials in the final simplified form have any common roots, these 
will lead to common factors, which may be cancelled out, except when 
z equals such a common root. When the rational function has been 
reduced to the quotient of two polynomials, without common roots, it 
is said to be reduced to lowest terms. The reduced form is defined for 
all values of z except those which make the reduced denominator zero. 
There may be other values of z for which the original form of the func¬ 
tion is undefined. If these are finite in number, we generally find it 
convenient to define arbitrarily the value of the original function for 
these values as the value of the reduced form. With this convention, 
the original function equals the reduced function for all values for which 
the latter is defined. 

If a rational function, reduced to lowest terms, is the quotient of two 
polynomials A ( z)/B(z ), it is said to be a proper fraction if the degree of 
the denominator exceeds that of the numerator, and an improper frac¬ 
tion if the degree of the numerator is at least as high as that of the 
denominator. 

By the division process used to obtain equation (215), we may replace 
any improper fraction by the sum of a polynomial and a proper fraction: 


M*) 

B(z) 


- CM + 


PM 

B{z) 


( 222 ) 
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This corresponds to the identity 

A(z) - C(z)B(z) + D(z), (223) 

which shows that for any value of z, b, which is a root of B{z), 

B(b) = 0, A(b) = D(b). (224) 

If A ( z)/B(z ) was reduced to its lowest terms, no root 6 is a root of A (z). 
Hence if B(b) = 0, A (b) ^ 0, and D(b) 0, so that the proper fraction 
D(z)/B (z) is in its lowest terms. 

Now let & be a root of B(z) of multiplicity r, so that 

B(z) = (z - b) r E(z), E(b) * 0. (225) 

Let us try to find a constant A r such that 

HU) U - by + (2 - b)'EU>' <226) 


where s < r, and the last fraction written is a proper fraction. Such a 
constant will make equation (226) an identity for all values of z for which 
both sides are defined and will imply that 

holds for all such values. If we let z—>b, we find: 


To show that a relation of the form (226) may be found with this 
value of A r) consider the identity: 

D(Z) _ Ar = D(z) - Arm 

B{z) (z - by (z - b) r E(z) ’ 


Since the numerator of this fraction is a polynomial which is zero for 
z = 6, by equation (228), it is divisible by (z — b). Thus, when the 
fraction is reduced to its lowest terms, the denominator will contain 
(s — b)* where s is less than r. This exponent will be r — 1, if b is a 
ample zero of the numerator. But it may be any lower value, includ¬ 
ing 0, if the numerator happens to be divisible by a higher power of 
(z — b) than the first. On the other hand, if b' is any root of E{z), the 
numerator reduces to D(b') for z = b', which is not zero since B(b f ) = 0 
implies D(b') s* 0. Thus no factors of E(z) are canceled out in reduc¬ 
ing the faction to its lowest terms, and the reduced form is that given 
in equation (220). Unless E(z) is a constant, there is a root b\ and the 
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function F(z) is not identically zero. If E(z) is a constant, and D(z) is 
also a constant, then the right member of equation (229) is identically 
zero, and we may put F(z) — 0 in equation (226) or omit the last term. 

Since the right member of equation (229) is a proper fraction, the 
last fraction in equation (226) is a proper fraction if E{z) is not a con¬ 
stant. Thus it may be treated in the same way we treated D(z)/B(z). 
If s is positive, we may again use the root b, if s = 0 , we use another 
root oi B{z), that is, a root of E(z). Since the process used yields a new 
fraction whose denominator is of lower degree than the one with which 
we started, after at most n steps we shall come to a fraction for which 
the equation (226) applies with F{z) = 0, or without the last term. 
This proves the possibility of decomposing any rational function into 
partial fractions of a kind described in the following theorem: 

Any rational function may be decomposed into the sum of a polynomial, 
and terms of the form 

7 ~^T~vt ’ i = 1> 2, • • •, to; k = l,2,--.,rv (230) 

(2 — Oj) 

where b\ f 621 * * *> b m are the distinct roots of the denominator of the function 
after it has been reduced to its lowest terms , and rj is the multiplicity of the 
root bj . 

We may prove in the following way that the decomposition is unique. 
If R(z ) is the rational function and b is a particular root of multiplicity r, 
from any decomposition we may obtain: 

*<‘> = (7(23.) 

by adding the polynomial and all the fractions except that with denomi¬ 
nator (z — b) r to obtain the second fraction. If we multiply by ( z — b) r 
and let z—*b, we find: 

A r = lim/J(z)(z — b) r . (232) 

z—+b 

Thus the coefficient A r is determined by the function. If we now sub¬ 
tract the fraction with numerator A r and apply the same argument to 
R(z) — A r / {z — b) r , we find that A T ~\ is determined. Continuing in 
this way, we see that the coefficients for any root b, are all determined 
by the function R{z). The polynomial part is determined, since it 
must equal the remainder when all the fractions are subtracted. Thus 
the decomposition is independent of the order in which the roots are 
taken. 

Since the sum of the fractions and polynomial of a decomposition 
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gives A(z)/B(z), the rational function R(z) reduced to its lowest terms, 
this fraction is independent of the manner of reduction. 

116. Taylor’s Expansions of Rational Fractions. If P(z) is any 
polynomial, and b is any complex number, we may divide the polynomial 
by z — b and deduce the equation: 

PM = (2 - b)Py(z) + Co, (233) 

analogous to equation (216). If Pj ( 2 ) is not a constant, we may repeat 
the process to obtain 

P 1 (z) = (z - b)P 2 (z) + c u (234) 

and so on until we come to 

P^lM = (2 - b)P n (z) + Cn-l. (235) 

Since each polynomial Pj(x) is of degree one lower than the preceding, 
if PM is of the nth degree, P„ ( 2 ) will be a constant, c„. By eliminat¬ 
ing the polynomials Pj(z) from the series of equations, we deduce 

PM = Co + Cl (2 - b) + c 2 (z - b ) 2 + • • ■ + c n (z - b) n . (236) 


The coefficients could be found by the process just indicated with less 
labor than the method used to obtain equation (192), equivalent to this 
with b = z 0 and 2 — b = h. 

However, we may express the coefficients directly in terms of deriva¬ 
tives. In fact, by putting 2 = 5 in equation (236), and in the equations 
derived from it by differentiation, we find: 

P w (b) 

c 0 = P(5), c,- = —^. j = 1, 2, • • n. (237) 


Equations (236) and (237) are analogous to those of section 82, but 
here the expansion is in closed form, and is valid for complex values of the 
variables. 

Let us consider next the decomposition of a rational fraction, 


M 2 ) 

B(z) 


where B(z) = (2 - b) r E(z), 


E(b) * 0. 


(238) 


By combining the polynomial and the partial fractions whose denomina¬ 
tors are not powers of (2 — b), we find: 


A ( 2 ) 

EM 


AM f A k HM 

B(z) h (z - b) k + E{z )' 


(239) 


At + At— 1(2 — b) + A r— 2 (z — 5) 2 + ‘ ' * 


+ A 1 ( Z -b)^" 1 


(2-6/H(2) 
+ EM 


(240) 


Thus: 
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Since I?( 6 ) 5 ^ 0, the fraction H (; z)/E(z) will have its derivatives of all 
orders finite for z ~ 6 . Hence, if we apply the rule of Leibniz for differ¬ 
entiating a product of section 72 to the product of this fraction by 
(z — b ) r , the terms in the derivatives of the first r — 1 orders will all 
contain a factor (z — b ) and so will vanish for z = &. Consequently, 
we may put z = b in equation (240) and the equations found from it by 
differentiating 1 , 2 , • • •, r — 1 times, and so obtain: 


A(b) 1 dr* VA{z)~ 

E(b)’ k ~ (r-k)\ dr-*Ltf(*)!.** 


(241) 


These formulas may be applied with A(z)/E(z) = R(z){z — b) r 
replaced by R\{z){z — 6 ) r , where R\(z) is the function with the poly¬ 
nomial removed, or with any fractions removed whose denominators 
are not divisible by (z — b). 

If we differentiate the right member of 

B(z) = (z - b) r E(z) y (242) 


successively by the rule of Leibniz, we note that the first r — 1 deriva¬ 
tives will contain a factor (z — b ) and so vanish for z = 6 , while the rth 
derivative will contain only one term, r ! E(z) which does not vanish for 
z a b. Thus: 

B(b) = B ; ( 6 ) = • • • = B (r ' l) (b) = 0, B (r) (b) = JS?( 6 ) ^ 0. (243) 


These conditions are in accord with the fact that the Taylor's expansion 
of B(z) in ascending powers of ( z — b) starts with (z — b) r . They may 
sometimes be used practically to detect multiple roots of a polynomial 
B(z) or the order of multiplicity of a given root. 

In particular, if b is a root of B(z), and B'(b) 5 ^ 0, then 6 is a simple 
root, and from equations (241) and (243) we find as the term for this 
root: 

where Ax = (244) 

z — b B (b) 

a formula of practical use in finding the coefficients for simple roots, 
particularly when they are real. 

If A ( z)/E(z) is any rational fraction, b any complex number such that 
E(b) 0, and r any positive integer, we may form the fraction which 
satisfies equation (238), and deduce equations (240) and (241). Thus, 
with changed notation: 

R(e) = Co + ci(z - b) + c 2 (z — b) 2 + • ■ ■ 

+ C„(z - b) n + Rim* - b) n+1 , (245) 
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where 

, _ P , h) , _ R(S) W 

Co = R{o), Cj — > 

3 ‘ 

(246) 

and 

R x (z)(z - b)" +1 = 0[(z - fe) n+l ], as z-+b. 

(247) 


This is a Taylor’s development for any rational fraction for values 
near b, for which it has a finite value. The last result follows from the 
fact that Ri (b) is finite, since R\ (z) is a rational function with the same 
denominator as R(z). 

117. Real Polynomials. By a real polynomial P (z) we mean one 
which has all its coefficients real. Let us replace z by a + ib, and so 
obtain the complex number: 

P(a + bi) = A + Bi. (248) 

If we now replace z by the conjugate value a — bi, we shall find 

P(a — bi) = A — Bi, (249) 

since the coefficients, being real, are their own conjugates, and addition 
and multiplication when applied to conjugate complex numbers yield 
conjugate results, as remarked in section 97. 

In particular, this shows that, if a + bi is a complex root of the real 
polynomial, so that A + Bi, and hence A and B, are zero, then a — bi 
is also a root. That is, for a real polynomial, non-real roots occur in 
conjugate pairs. A pair of conjugate complex roots in the factorization 
(219) corresponds to two linear factors whose product 

(z — a — bi) (z — a + bi) = z 2 — 2 az + a 2 + b 2 (250) 

is a real quadratic factor. As division by such a factor yields a new real 
polynomial of lower degree, a real polynomial may always be factored 
into a number of real factors of the first or second degree, and two 
conjugate roots of a real polynomial will have the same multiplicity. 

118. Real Rational Functions. A real rational function is one 
which, when reduced to its lowest terms, is the quotient of two real 
polynomials. If we start with such a function whose reduced form 
A(z)/B(z) is an improper fraction, division will yield a real polynomial 
C(z) and a real proper fraction D(z)/B(z). If the polynomial B(z) 
has the quadratic factor 

z 3 + pz + q = (z — a — bi) (z — a + bi) (251) 

corresponding to a pair erf conjugate complex roots, and each root is of 
multiplicity ^ we may write 

J'H' B(z) ~ (z* + pz + g) r G(z), 


(252) 
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with O(z) a real polynomial. Thus for the first root, a + bi, the 
coefficient A r of equation (228) will have the value 


D(a + bi) 

(2&) r <?(a + bi) ’ 


(253) 


while the corresponding coefficient for the conjugate root, a — bi will 
have the value 




D(a ~ bi) 

(-2M) r G(a - M)’ 


(254) 


which is the conjugate of A r . 




follows: 

£>(*) = 

B(z) (z — a 




A r 


bi) 


, _ h. , . UA (255 % 

(z — a + bi) r ( z 2 + pz + #)*(•?(£) 


where s < r. Since the left member is a real function, and the two 
conjugate fractions add up to a real function, the third member is also 
real. This shows that the next two coefficients, A r ~ x and A r _ i, will be 
conjugate, and continuing in this way we see that all the coefficients in 
the expansion of section 115, for conjugate complex factors will be 
conjugate complex numbers. 

If we wish to keep the decomposition real, we may add up the two 
conjugate fractions in equation (255), and so obtain a fraction 


H(z) 

(z 2 + pz + q) r 


(256) 


By division, we may obtain 

H (z) = J ( z) (z 2 + pz + q) + P + Qz, (257) 


the remainder being of the first degree. 

This enables us to write 

At At = P + Qz _ Jjz) _ 

(z — a — bi) r + (z - a + bi) r (z 2 + pz + q) r (z 2 + pz + q)^ 1 

(258) 


If we substitute this expression in equation (255), and combine the last 
fraction in equation (258) with the last fraction in equation (255), we 
shall be led to the decomposition 


D(z) _ P + Qz _ Kjz) 

B(z) ~ (z 2 + pz + q) T (z 2 + pz + g)‘G(z) * 


(259) 


with t < r. 
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Equation (228) shows that A r in equation (226) is real if & is real, and 
D(x) and B(x) are real polynomials. 

We may use these facts to prove a unique decomposition in which all 
the coefficients are real: 

Any real rational function may be decomposed into the sum of a poly¬ 
nomial , terms of the form: 

(3 — by ’ ^ ~ ^ } Tf (260) 


one series for each real root b of multiplicity r, and terms of the form 


P + Qz 

(z 2 + pz + q) j 9 


3 = 1, 2, 


r. 


(261) 


one series for each real quadratic factor z 2 + pz + q , corresponding to 
a pair of conjugate complex roots of multiplicity r of the denominator after 
the function has been reduced to its lowest terms. 

In this decomposition the coefficients are uniquely determined and will 
all be real. 


119. The Derivative of a Complex Function of a Real Variable. If 

s(x) and t(x) are two real functions of the real variable x, defined for a 
certain range, the function 


w(x) = s(x) + it(x) (262) 

is called a complex function of the real variable x. Any association of 
complex numbers with the real values of x in the range determines a 
complex function of x , with 

s(x ) = R[w(x)] and t(x) = I[ic(x)j, (263) 


the real and imaginary components of w(x). 

We say that the function w{x) has a derivative for real increments if 


„ w{x + h) — w(x) 

hm--- 

h -+o h 


(264) 


exists for all real sequences of values of h, h 0. We use dw/dx or 
w'(x) to denote this derivative. 

If t(x) is zero, this definition agrees with that of section 62. Suppose 
next thatt0(x) is obtained by putting z = x in a function w(z) defined for 
complex values, which has a derivative for complex increments, F'(z) in 
the sense of section 110. Then, for z = x, the expression (264) will 
approach w f {x) for all complex sequences h approaching zero, and hence 
in particular for all sequences of real values approaching zero. Thus 
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whenever our previous definitions assign a meaning to w'(x), the defini¬ 
tion just given is consistent with it. 

Of course w'(x ) may exist without w'(z) existing for z — x, and A z 
complex. This will cause no confusion, since we shall for the most part 
be concerned with elementary functions whose derivatives may be found 
by the methods of section 112 . 

Since 

w(x + h) - w(x) s(x + h) — s(x) . f(x + h) — t(x) 

-—- h - - h -+,-j—• w 

it follows from equation (35) that w(x) will have a derivative for real 
increments if, and only if, s(x) and t(x) have derivatives. Also, in this 
case, 

R[n/(x)] = s'(x) and (a:)] = t'(x). (266) 

Thus, if a complex function w(x) has a derivative for real increments, 

|RWx)l-R[f] and |%(x)I-lg]- (267) 

120. Higher Derivatives. We may now express the higher deriva¬ 
tives of certain real elementary functions in a simple form. 

Consider first a rational function with real coefficients. By the theo¬ 
rem of section 115, and the discussion of section 118, such a function may 
be represented as a sum of terms of the form 

cx r and 7 —— 77 : > (268) 

(x - b) r 

where r is integral, c is real, and either b and A are real, or b is complex 
and the sum includes the corresponding conjugate fraction obtained by 
replacing b and A by their conjugates b and A. 

For the first form, we have for the nth derivative: 

— (ex') « r(r - l)(r - 2) • • • (r - n + ecx""”, (269) 

dx n 

so that the derivative is zero for n > r. 

For the second term, the nth derivative is 

+ Dfr + *>- (r + • - 1) 

(270) 

This is real as it stands, when b is real, and hence A real. 
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When ft is not real, the sum of the fraction and its conjugate will give 
twice tie real component of the fraction, 


S 


A 

(x - by 


+ 


I 

(x — by 



and by equation (267) 


d n S 

dx n 



(271) 


(272) 


which may be found from equation (270). 
Again, consider 


e (p+«i)i _ e px cog q X _|_ £ e pz g j n y X 

From equation (267), we find: 

~ (e px cos qx) = R[(p + 8 i)V p+#,) *l, 
d n 

and — ( e px sin qx) = I[(p + 5 i) n e Cp ' , " 9 ’ )l ]. 

ttX 


( 273 ) 


(274) 

(275) 


EXERCISES V 

1 . Let P be the point on the line through Pi and P 2 for which P X P jPP 2 = 
9 i/st, any real ratio. Show that if P 1 and P 2 represent zi and z 2 , then P repre¬ 
sents (s%zi + 81Z2) I (s 2 + si). We say P divides the segment in the ratio «i/s 2 , 
and include s 2 = 0, s x 5* 0 to mean PP 2 = 0. 

2 . Let us associate real numbers m % with points P x or z % . By problem 1, the 
point dividing PiP 2 in a ratio inverse to that of their numbers is P* or 
(mi«i + m^) /(mi + m 2 ). We may associate the number m x + m 2 with this 
point, and treat P* and P3 as we did P x and P 2 . Show that, if we continue until 

n J n 

n points are used, we shall obtain a point G or TJ m x z x £ m Xf the weighted 

average or center of mass of the weighted points. The result shows that G is 
independent of the order in which the points are taken or grouped, and the 
construction shows it to be independent of the choice of axes or scale. 

3 . Prove that if 2122 is real, and 21 + z 2 is real, then either 21 and z% are both 
real, or they are conjugate and 22 = z x . 

4 * Prove that if z « x 4* iy t (|x| + \y\) / Vi rg \z\, and that the equality 
only holds if \x\ « |y|. 

5 . Let 0, Pi t Pt be three given points in a plane. We may fix a coordinate 
system by putting 0 ® ( 0 , 0 ) and any point U distinct from 0 as the unit point 
U *» (l # 0 ). In this system let 21 and 22 be the complex numbers for P x and P 2 . 
Show that the point for the quotient 21 does not depend on the choice of ( 7 , 
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but that any point P distinct from 0 may be made to represent z\z% by an appro¬ 
priate choice of 17. 

6* Prove the following geometric construction for the roots of the quadratic 
equation az 2 + bz + c « 0 , with a, b ) c real. If the circle with i and 
—b/a + ic/a as diametral points cuts the real axis, these points give the real 
roots. If the circle with 0 and —2clb as diametral points cuts the line 
x » —b/2a f these points give the conjugate complex roots. Equal roots are 
given by the point of tangency in either case. 

7. Prove that if z = x + iy, je*| = a®, |e“ e | = 

8. If p is any real number, \e tp \ = 1. 

9. De Moivre’s theorem states that for real 0, 

(cos 6 + i sin 6 ) n = cos nd + i sin n0, 


where n is a positive or negative integer. Prove this. 

10. Show that the identity of problem 9 holds if Q is complex, and for one value 
of the left side if n is any complex number. 

11. Prove that the roots of az 2 + bz + c = 0 are 


yp 

fit A 
\ - tan — 
v n 9 


tan ~ and 
2 


and 


4 

“ a 


- cot — if tan A — - V— ac ; 
a 2 b 

\/~cot“ if sin A = — - V ac; 

' a 2 b 


and (cos A Az i sin A) if cos A = 


2 Vac 


If a, b and c are real, a real 


value of A can be found from one of the conditions. 

12. If P(z) — az 2 + bz + c with a, b, c real, and z = x + iy, express R(P), 
I(P) and |P(2)| 2 as polynomials in x and y. 

13. A pair of relations u = u(x,y) and v = v(x,y) may be geometrically 
interpreted as a transformation of points in the plane, which takes (x,y) into 
(u,v). Show that if w = z + «i, the transformation is a translation, and that if 
w = e ta z, the transformation is a rotation about 0. Also that w = e w z + t\ 
may be made to represent any rigid displacement of the plane on itself. 

14. If A 9 * 0, interpret w — Az as a similarity transformation, and hence 
interpret w = Az + B. 

16. A geometrical inversion of the plane in the unit circle replaces the point P 
by P', where P f is on OP or OP produced beyond P and OP • OP' - 1. Thus, 
in polar coordinates 0' = $ and r' = 1 /r. Hence w = 1 fa a continuous func¬ 
tion of z except when z - 0. Show that u = x/(x 2 + y 2 ) and v * y /(x 2 + y 2 ) 
and that the inverse of the curve a(x 2 + y 2 ) + bx + cy + d = 0 is the curve 
d(u 2 + v 2 ) + bu + cv + a = 0. If we complete the inversion plane by a 
“ point at infinity ” I, the inverse of 0, the transformation is single-valued for all 
points. It takes 0 into I and, since it is its own inverse, I into 0. An inversion 
takes “ circles/' including straight lines as a special case, into “ circles." Show 
that the straight lines, or the only “ circles ” through /, go into “ circles ” 
through 0, and conversely. 
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16 . Show that the equation of a straight line may be written Sz + Sz -f t * 0, 

with t real, while that of a circle may be written \z — S| 2 = (z — S)(z — S) ~ t 2 . 
Hence, when the locus of + Sz + Sz + t «= 0, s, t real is more than one 
point, it is a " circle/’ with tww + Sw + + s — 0 as its inverse under 

w * 1/5. 

17 . Interpret w ** l/z as a combination of an inversion and a reflection, and 
show that it transforms the “ circle ” of the preceding problem into the “ circle ” 
with equation tww + Sw + Sw + s = 0. 

Az -f* B 

18 . The relation w — ~-— > where AD — BC ^ 0 defines a bilinear trans- 

Cz + D 

formation. If C = 0 it reduces to that of problem 14. If C 0 it may be 
represented as a combination of such transformations with one of the type 

w f * 1 jz' } e.g., with w = w' + A jC and z' = ——- • 

BC-AD 

19 . If we introduce the point I of problem 15, the bilinear transformation of 
problem 18 is single-valued. It takes I into I if C = 0 and if C j* 0, it takes 
— D/C into I , and I into A /C. Show that it takes “ circles ” into “ circles/’ 
and state which ones go into straight lines or are the images of straight lines. 

20. Find the equation of the image of the “ circle ” of problem 16, when 


Az 4- B __ Az + B 

—-- Hint: Use w ~ =-— • 

Cz + D Cz + T5 


21. Show that the locus of arg - 


= a is an arc of a “ circle ” through 


the points z\ and z 2 . The other arc of the same “ circle ” is given by replacing 


a by a 


The locus of 


— p is a circle intersecting all the arcs for 


varying a at right angles. 

22. Show that a necessary and sufficient condition for four points to be con- 
cyclic, i.e,, lie on a " circle,” is that the cross-ratio of their complex values taken 

in any order, e.g., —-- ~ > be real. Hint: Use the first result of 

ZZ — Z 2 Zi Z\ 

problem 21. 

23. If the transformation of problem 18 takes z\ into Wi and z 2 into w 2} show 

that ??-~ , ?- Z A . Hence show that the cross-ratio of four 

w — w 2 Cz\ + D z — z 2 

points equals the corresponding cross-ratio of their images. This, with problem 
22, proves that “ circles ” go into “ circles.” By using problem 21 directly, 
show that each of the families there mentioned for z\ and z 2 go into correspond¬ 
ing families for wi and w 2 : _ 

24. If z * x + iy, prove that |sin z\ = Vsin 2 x + sinh 2 y, |cos z\ = 


cos 2 x + sinh 2 y } jsinh z\ « v BW?y + sinh 2 x , and |cosh z\ * V cos 2 y + sinh 2 #. 

25. Using problem 24, or otherwise, show that 

|sinh y\ S jsin z\ ^ cosh y, jsinh y\ % jcos z\ JS cosh y , 

|sinh #| Ja jsinh z\ cosh x and jsinh z\ jcosh z\ Ss cosh x . 
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26. Prove that the roots of the special cubic equation 4z 8 + 3z + p * 0 
aresinh A, — §sinh A ± \ V3icosh A if p = —sinh3A; whilefor4z a — 3 z + 
V - 0, the roots are cosh A,~ \ cosh A =t \\/z sinh A if p = —cosh 3A; and 
sin A, sin (A dz 2ir /3) if p = sin 3A. If p is real, one value of 3A is real. 

27. Let z 8 + az 2 +_&z + c = 0. Show that if 2 = 2 ' — a /3, z n + 6V + c' = 

0, and if z' = 2 ", then 42 " 3 db 3s" + p = 0. Combine this with the 


preceding problem to develop a method of solving any cubic with real coefficients. 

28. If z is any complex number, and w = 2 tan" 1 e* — w /2, then w is 
called the Gudermannian of 2, and we write w — gd 2 . Prove that z = 


!°g tan (“j + “) 


and that: 


sinh 2 = tan w, cosh 2 = sec w , tanh 2 = sin w, coth z = esc id , 
csch 2 = cot id, sech 2 = cos w. 


29. Prove that the points representing the qth roots of any complex number 
are the vertices of a regular polygon with center of symmetry at the origin. 
Hence show that the vectorial sum of the lines drawn from the center to the 
vertices of any regular polygon is zero. 

30. Let ak be any complex constants, a„ 5 ^ 0, and bj be the roots of the 


n 

polynomial £ dkZ k — P{Z). Show that if L(w) denotes the corresponding 
*=0 

n / d\ n / d\ 0 

differential operator £ a k () id, where! ) = l,then 
jfc=o \dzj \dz/ 

t W - a. (| - J.) . .. - (,,) (| - 1.) «, 


where the operators on the right may be taken with any order of the b v 


31. From problem 30 and 



z k d>* = deduce that Ce 6 * is a 


solution of L(w) = 0 if b is a simple root of P(Z), and (C 1 + C 22 + * * * 
+ C r z r " 1 )c fe£ is a solution if b is a multiple root of order r, where C and the Cf 
are any complex constants. 

32. In the preceding problem, the sum of two solutions is a solution. Hence 
show that if p zh qi is a pair of conjugate complex roots, C'e pe cos qz and 
C”e pz sin qz are solutions, with C f and C ft replaced by (r — l)st degree polynomi¬ 
als if the roots are each of multiplicity r. If all the ak are real, and 2 is real these 
solutions involve real functions only. 

33. If we write for the Liw) of problem 30, L(w) = P(D)w, and interpret 


1 

P(D) 


f(z) as any solution of 


L{w) = /, then in particular 1 /(Z) — b )/is any solu¬ 


tion of (D - b)w * /, or dw jdz - bw = /, and 1 /(D - 6) n /is any solution of 
(D — b) n w = /. Also A 1 t(D - 6) / and 1 /(D - 6) A/ have the same meaning 
for A a constant. Show that if F(Z) denotes the partial fraction decomposition 
of 1 /P(Z), any of the interpretations of F{D) / is an interpretation of 1 /P(D) /. 
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This enables us to obtain solutions of L(u>) = / from those of equations of 
simpler type. 


34. Deduce a rule for finding solutions of £ “*** 

Jfe-0 


( I )*”- 0 


the 


form C (log z)*£> in terras of the roots of the equation 22 Z(Z — 1) • • • 

(Z — k + l)a* + a 0 = 0, with s * 0 for simple roots, and s - 0, 1, 2, • • •, or 
r — 1 for roots of order r. Hint: Put z « log z\ and use problem 31. 


35. Verify that for f(z) = e* f z\ = 0 and z% = ti /2, 


|/fe) — /(*i) 


22 — 


2V2 


< 1, 


while if 23 is any point of the line segment joining z\ and 22 , |/ / (*s)| = 1. This 
proves that the law of the mean does not hold for complex variables in the form 
valid for real quantities. 

33. Decompose - into simple partial fractions, and also into the simplest 


z n - 1 

fractions of real form. .Ans. 


b k 


fc —1 n(z — b k ) 

form includes a simple fraction —-— in all cases, and 


» where b k = e 2kwiln . The real 
-1 


together with 


37. Decompose 


n(z — 1) 
2 [cos (2kir /n) — 1] 
n[z 2 — 2z cos (2kir/n) + 1] 
z~ 


n{z + 1) 


if n is even, 


for 


* - 1, 2, - • ■ 


z" - 1 


into simple partial fractions. Am. £ 


by' 


1 n(z - b k ) 

where 6* = e ikriln , if m < n; and if m ^ n the polynomial z m ~" + z m ~ 2n + • • 






must be added. 


38. Let i4(z) be a polynomial of degree at most q — 1 and B(z) a polynomial 
of the gth degree with B(0) 0, so that there is a Taylor's expansion of A (z) /B(z) 
about z « 0, 

m 

B(z) 


Uq + U\Z + U& 2 + * * • + UmZ m + 0(z m+l ). 


( 1 ) 


Show that if B(z) = 22 a kZ k , a q ^ 0 and ao ^ 0, then 

fe-0 

0 ® + aiUr^i + 02 W n ^ 2 4- • • • 4- a 4 Wn- tf , n g. 


( 2 ) 


Conversely, show that if a sequence of numbers uo, u h uq, * • *, satisfy (2), the 
first q values determine a polynomial 4(z) of degree less than q for which (1) 
is satisfied for any m. 

39. Prove that the Taylor’s development of R f (z) the derivative of any 
rational function B(z) may be obtained from that of R(z) by termwise differentia¬ 
tion. Hence prove by induction the binomial expansion for integral r and 
&**0: 


1 


/ *YA . , m(m + l) • • * (m + r-l) 

riA ,+ * + "' + -<^»T- 




+ 0(z"+>). 
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40 . Identify the Taylor’s expansion of A(z) jB{z) of equation (I) problem 38 
with that of its partial fraction expansion obtained from problem 39. Hence 
show that Um is a sum of terms of the form for each simple root of B(z), 
and (Ci + Cm + • • • + C r m r ~ l )b~ 7n , for each multiple root of order r, where 
the C's are independent of m. 

41 . A relation similar to equation (2) of problem 38 is called a linear difference 
equation of the qth order with constant coefficients. From the preceding prob¬ 
lems deduce a rule for expressing any sequence which solves such a relation in 
terms of q constants. Show that the constants can always be determined to 
make the first q u n , u 0 to u q - 1 take any given values. The solution for Um will 

be a sum of terms of the form (Ci + Cm + • • • + C r m r ~ 1 )P m , if the $ are the 
« 

roots of £ a q -kZ k , whose relation to (2) is easily recalled by replacing u n in 
Jfc«0 

(2) by CZ n . 

42 . Show that if f(x + na) — u n> any linear relation with constant coefficients 
between the differences of section 93 of the first q orders and the function itself 
leads to a difference equation of the qth order, as defined in problem 41. In 
particular, show that if the qth difference is constant, u n is a gth degree 
polynomial in n. 

43 . If u n — 2 cos Au n - 1 + u n ~ 2 = 0, show that u n = Ci cos nA + c 2 sin nA 
if sin A 7 ^ 0, C\ + c 2 n if cos A = 1, and c\ + c 2 (—l) n n if cos A = —1. Hint: 
Use problem 41. 

44 . If the roots fi of problem 41 all have \fi\ < 1, then lim u n = 0. If one 

n .» -{-oo 

root equals 1 and the remaining q — 1 roots have jy3| < 1, then any particular 
sequence approaches a limit. Show that this argument applies to any equation 

with X l°*l = M, and in particular to qu n — w n _jt = 0. Solve explicitly 

jb-i 

for q = 1, 2, 3. 

46. If z = x(t) + iy{t) is a function of the real variable t } the time, the velocity 
vector is x'(t) + iy'(t) - z'(t) } and the acceleration vector is x"(t) + iy n (t) - 
z''(t). Write z = re where r and 0 are functions of t, and hence verify that the 
velocity has a component r' along the radius vector and rd f perpendicular to it, 
while the corresponding components for the acceleration are (r" — rd n ) and 

- (r*0)'. 

r 

46 . By writing z’ = ve i4> in problem 45, show that the acceleration has a com¬ 
ponent v' parallel to the velocity vector, and v<j>' perpendicular to it. 



CHAPTER VI 
INTEGRATION 


We devote this chapter to the special limit process, integration, which 
plays a central role in the integral calculus. We define this limit process, 
and prove its applicability to continuous functions. We investigate 
some of the properties of integrals and, in particular, show that under 
certain conditions integration and differentiation are inverse operations. 

We show that for each continuous function, the process of integration 
defines to within an additive constant an indefinite integral function 
which has the first function as its derivative. In fact, the definition of 
integration leads to a method by which the integral function could be 
computed. 

We then discuss the problem of representing the integral of certain 
types of explicit expressions in terms of a small class of known functions. 
We show that the integral of any rational function can be expressed in 
terms of rational functions, logarithms, and inverse trigonometric func¬ 
tions, and we describe a number of other classes of expressions whose 
integrals can be found in terms of elementary functions. 

We mention a few integrals not of this character, including the three 
standard forms of elliptic integrals, and prove that the integral of any 
rational function of x and the square root of a polynomial in x of at most 
the fourth degree can be expressed in terms of elementary functions and 
the three standard forms of elliptic integrals. 

121. The Definite Integral. Let y = f{x) be a single-valued func¬ 
tion on the closed interval a g x ^ b, and bounded on this interval in 
the sense of section 31. In order to define the integral of the function 
f(x), we divide the interval a, b into n subintervals by the points: 

a = Xq < Xi < x 2 < * * • < x n = b, (1) 

which satisfy this relation but are otherwise arbitrary. 

. . . HH _ 

* 2 * • • ii x i • • • x n - i **— 6 

Fig. 14. 

Let & be any point in, and Si the length of, the tth subinterval so that: 

Xi -1 £ & S Xi and 5,- = x,- - x,_i. (2) 

194 
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Now form the sum: 

+f(( 2 )S 2 + • • • +/({n)5n 

= £fcm. (3) 

The sum S^epends on the number n, the choice of the Xi, and the 
choice of the fc. 

Let us denote the maximum of the n positive quantities 5* by 8m, 

8 m = max (5*), (4) 

and consider an infinite discrete sequence of sums St for which 

lim 8 m = 0. (5) 

If, for any sequence of this type, the values of St approach a finite 
limit, and if this limit has the same value, /, for all such sequences, then 
I is called the definite integral of f(x) for the interval a, b. We then say 
that the function f(x) is integrable over this interval a,b, and we write: 

b 

f(x)dx = I = lim S t . (6) 

The process by which I was derived from f(x) is called Riemann 
integration , or simply integration. In the expression for 1 just written, 
we call/(a;) the integrand, x the variable of integration, and a and b the 
limits of the integral. 

122. Integrals of Continuous Functions. In order to show that there 
are some functions to which the process of integration as defined in the 
preceding section is applicable, we prove next that: 

A function f(x) is integrable over any closed interval throughout which it 
is continuous. 

Let f(x) be continuous over the closed interval a,b. Then, by section 
32, it is uniformly continuous in the closed interval. Thus we may 
select a 8 0 such that, for any positive quantity r?, 

l/fe) -/(*|)| < «, if 1*2 ~ *i| < 5o, (7) 

where 

n 




Now consider two sums: 

S = and S' = 

t-1 


(9) 
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such that: 

Sm = max (8.) and h' u = max («'•) (10) 

3 0 

are each less than ~ # 

2 

(ID 

Next mark all the points of subdivision of each set, x,- and x/, to form 
a new subdivision. Let these points, taken in order with a point in both 
sets counted only once, be called x' k ', so that 

a - 4' < x[' < x? < • • • < x" = 6, (12) 

and let 

Si' = x*"- (13) 

denote the length of the fcth interval. Then 

£ S" = b — a. (14) 

fc-1 

The difference of the two sums S and S' may be written: 

S - S' = £ [/(*,) - /(#&', (15) 

i-l 

where is in that interval of the first subdivision which includes the 
points x' k Li and x k , and £' is in that interval of the second subdivision 
which includes these points x' k '_i and x”. Thus and lie in two 
intervals which overlap, since they each contain the kth interval of the 
third subdivision x*Li, x k . Hence we have: 

\b - f,'i ^ Si + (i6) 

or, in view of the relations (10) and (11), 

- f/l < S 0 . (17) 

This, combined with the relation (7) shows that: 

l/(fc) -/(£)!<*, (18) 

and since this is true for each term of the sum in equation (15), we deduce 
that 

\8 - S'\ - I £ [/({,) - f(&]S' k '\ < £ al'. (19) 

k-l k -1 

Hence it follows from equations (14) and (8) that: 

|S - 8 '1 < *(b - a) £ r». 


( 20 ) 
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Let us now apply this to a sequence St. Since, for such a sequence, 
we have the relation (5), there will be a certain point in the sequence, 
to, beyond which 5 m < 8o/2. Hence, the difference of any two values 
of St, with t beyond fo, will be numerically less than y, since we may take 
these two sums St as the S and S' of the relation (20). 

Thus the sequence St approaches a finite limit Ii by the Cauchy con¬ 
vergence criterion of section 26. 

Next, consider any second sequence S' t . This approaches a finite 
limit h by the argument just given. Thus 

lim (S t - Si) = h - h. (21) 

But, if for the second sequence 8' M < 5 0 /2 for t beyond to, for all values 
of t beyond to and <o we may take S t and S( as the S and S' of the rela¬ 
tion (20), so that: 


IS* — S( j < r?, for t beyond to, 

(22) 

The relations (21) and (22) show that 


|/i — / 2 I < V) 

(23) 

and hence 


0 

II 

<N 

1 

H 

(24) 

since y is arbitrary. 



Thus the limit J 2 is the same as l x , and there is a common limit I for 
all sequences, as we set out to prove. 

Let us return to the relation (20), with S any sum for which 8 m < So/2 
and with S' replaced by any value of St, with t beyond t 0 . Then we have: 

|iS — <S«| < v, for t beyond to. (25) 

If we let t become infinite in this relation, and recall that the limit of 
St is 7j, or 7, we have: 

|S - 7| < v (26) 

Thus any sum with 8 m < So/2 approximates the value of the integral 
to within y. 

123. Linear Properties of the Integral. The definition of 

was made on the assumption that b, the upper limit of the integral, was 
greater than a, the lower limit of the integral. 

The use of the word limit as applied to a and b, the end points of the 
interval over which the integral is taken, is well established but has little 
connection with the various technical meanings of limit defined in 
Chapter II. 
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We extend the meaning of the expression for an integral by defining; 

/.» 


and 


f fix ) dx, if a > b, 

(27) 

Jb 

1 

fix ) dx = 0. 

(28) 


Thus the equality in the relation (27) holds when a = b, and hence 
for all values of a and b. 

If the values a, b, c are such that a < b < c, it follows from the 
original definition of the integral in section 121 that: 





(29) 


since we may evaluate the integral on the right by using a sequence of 
sums, for each of which the point b is one of the x 
If a = b or b ■» c, equation (29) is an identity in view of equation 
(28). And, by equation (27), equation (29) may be written: 



dx = 0. 


(30) 


This is symmetrical in a, b, and c and so holds without any restriction 
on the order of the three quantities. 

The definitions (27) and (28) are motivated by the desire to have 
equation (29) hold for all values. 

By a repeated application of equation (29) we may show that the 
integral of a function depends linearly on the interval of integration, in 
the sense that if a finite number of intervals are added or subtracted to 
form a new set of intervals, the integrals combine in the same way. 

For a fixed interval of integration, the integral depends linearly on 
the function, in the sense that, if u and v are two functions of x, each 
integrable for the interval, 


and 




ku dx 



/ s*b 

(u + v)dx - I u dx+ I 


v dx. 


(31) 

(32) 


These relations follow from the linear character of the sum (3) from 
which the integral was obtained by a limiting process. 
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124. Inequalities. If two functions, fix) and g(x), are each integrable 
over the interval a,b, and throughout this interval 

fix) g gix), (33) 

then it follows that: 

fj {x) dx ^ J *g(x) dx . (34) 

For, if we use the same n, x* and 5* to form a sum 8 for each function, 
it follows from the relation (33) that 

if ( 35 ) 

»«1 i®l 

Thus, if we form two sequences of sums related in this way, and take the 
limit, we may deduce the relation (34). 

We note next that, if f(x) is a constant, fc, each/(&) = k } and we have 
in place of equation (3): 

S = ik8i = kit, Si = k(b - a), (36) 

*®i i*i 

so that the limit of any sequence S t is k(b — a) = J. Thus the integral 
of a constant is the product of the constant times the interval of inte¬ 
gration when a <b. By equations (27) and (28), we have in all cases: 


J kdx = k(b — a). 


If m is any lower bound and M any upper bound for the function f(x) 
on the closed interval a,6, we have: 

rn ^ /(x) g M. (38) 

This implies that: 


X b rj) r%b 

mdx fix) dx M dx, 


or, in view of formula (37): 


lib — a) g J" fix) dx g Mib — a). 


The number K defined by 


K - —5- /*/(*) dx, (41) 

0 — CL d a 

is called the average value of the function /(x) for the interval a,b. It 
follows from the relation (40) that: 


(42) 
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Since m and M are any bounds for the function /Or), we may in 
particular take m as the greatest lower bound, and M as the least upper 
bound, and express our result in the theorem: 

The average value of a function integrable between a and b, 

K = r~— f/(*) dx, (43) 

o — a J a 

lies in the closed interval whose end points are the greatest lower bound and 
least upper bound of the values of f (x) between a and b. 

In this form the result holds if a > b, in view of equation (27). 

Again, if g{x) 2s 0 throughout the closed interval a,b, and f(x)g(x) 
as well as g(x) is integrable for this interval, we may deduce from the 
relation (38) that: 

mg{x) g f(x)g(x) g Mg(x). (44) 


This implies that: 


J 

r*& rsb 

mg(x) dx ^ 1 f (x)g(x) dx £ 1 Mg(x) dx. 

3 v o ** a 

(45) 

or, in view of equation (31): 


m j 

s\b pfb f\b 

f g(x) dx g 1 f(x)g{x) dx ^ M 1 g(x) dx. 

a a J a 

(46) 

It follows from the condition g(x) ^0 that / g[x) dx §£ 0. 

If this 

a 

integral is positive, there is a constant k uniquely defined by 



s*b s%b 

1 f(x)g(x) dx - k I g(x) dx. 

(47) 

From this and the relation (46) we may deduce that 



m g k £ M. 

(48) 


If the integral of g(x) equals zero, the relation (46) shows that the 
integral of f(x)g(x ) is also zero, and then the equation (47) holds for all 
values of k. 

If a > b, or if g(x) ^ 0 throughout the interval, some of our inequali¬ 
ties are reversed, but a similar conclusion may be drawn. Thus we may 
formulate the theorem: 
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If g(x) is never negative {or never positive ) throughout the closed interval 
a,b, and g(x) as well as f(x)g(x) is integrable over this interval, we may 
write 


X 


f(x)g(x) dx = 



(49) 


where k is a suitably chosen value between the greatest lower bound and the 
least upper bound of fix) for the closed interval . 

126. Mean Value Theorems. If the function f(x) is continuous 
throughout the closed interval a } b there will be two points in this inter¬ 
val, xi and x 2 , such that 

f(x x ) = m and f(x 2 ) = M, (50) 


where m is the minimum and M the maximum value of the function for 
the interval, as wo proved in section 33. Hence we may take these as 
the m and M of equation (38). 

But, any number K such that m ^ K ^ M is either m, taken on at 
Xi; or M y taken on at x 2 ; or an intermediate value in the sense of 
section 34, and therefore taken on at some point between X\ and x 2 . 
Thus, there is a point £ between a and b such that K = /(£), and the first 
theorem of the preceding section becomes, for continuous integrands: 

If the function f(x) is continuous on the closed interval a,b there is a point 
£ of this interval such that : 

f f{x) dx = /(|) (6 - a). (51) 

This is known as the first mean value theorem for integrals. 

Similarly, there is a point £', of the closed interval such that k = /(£'), 
and we may restate the second theorem of the preceding section: 

If the function f(x) is continuous on the closed interval a y b; if g(x) is 
never negative (or never positive ) throughout this interval; and if g(x), as 
well as f(x)g(x) } is integrable over this interval: then there is a point £ / 
of this interval such that 

f f{x)g(x) dx = /({') f g(x) dx. (52) 

126. Evaluation of the Integral. Suppose that f(x) is a function 
integrable over the interval a,b and throughout this interval is known to 
be the derivative of a second function F(x), so that 

f{x) = F'{x). 


(53) 
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Then we may apply the law of finite increments of section 74 to the 
function Fix) for each of the subintervals used in section 121, and so 
find points & such that 

F( Xi ) - F(xi_ x ) = F'itfixi - x<_,). (54) 

Now use these values as the £, in the sum for S in equation (3). We 
shall then have: 

/({,)«» = F'i^ixi - Xj_i) = F(xi) - F(x^), (55) 

so that: 


S — +/(fc)5 2 + • • • +/(fn)5 n 

- F(*i) ~ F(*o) + F(x 2 ) - F(x i) -[- F(x n ) - F(x»_i) 

= FM - F(x o) = F(b) - F(a). (56) 


Thus we may form a particular sequence S t for which the are always 
chosen so that equation (54) is satisfied, and for this sequence the values 
of St are all equal, so that the limit is F(b) — F(a). 

Since/(x) is integrable, the limit will be the same for all other se¬ 
quences, and hence we shall have: 

//(*) dx = F(b ) - F(a). (57) 

If- 


We write F(x) 


in place of F(b) — F(a). 


If <r(x) is any second function such that/(x) = G'(x) throughout the 
interval a,b and we write H(x) — G(x) — F(x), we shall have: 


ff'(x) = G\x) - F'(x) = 0, a g x g b. (58) 


Hence, by the theorem deduced from equation (117) of section 75, 
H(x) = c, a constant, and G(x) = F(x) + c. 

Any function having/(x) as its derivative is called an indefinite inte¬ 
gral of fix). It is clear that if F{x) is an indefinite integral of fix), 
then Fix) + c is also an indefinite integral of fix), and we have just 
proved that all indefinite integrals are of this form. The symbol 

P <*> dx or J* fix) dx is used to mean any indefinite integral. 

We restate the main result of this section: 

If fix) is an integrable function over the interval c,d and Fix) is any 
indefinite integral of fix), so that fix) = F'(x) throughout the closed 
interval c,d, then 


f. 


fix) dx = Fix) 


Fib) - Fia) 


(59) 


for a and b, any two points of the closed interval c,d. 
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That equation (59) holds when a = b follows from equation (28), 
and that it holds for b < a follows from equation (27). 

127. Dummy Indices and Variables. In a finite summation, abbrevi¬ 
ated by the symbol 2* with an index of summation i, the precise letter 
used for the index of summation is of no importance, since it does not 
appear in the sum when written out in full. Thus: 

kh, (60) 

*-l 1 ft-1 

since each is an abbreviation for <$i + $2 + £ 3 . We call such an index a 
dummy index. We may always replace a dummy index by some other 
letter, and to do so sometimes clarifies an argument and avoids confusion. 
This was the case in section 122, where we replaced i by j in the summa¬ 
tion S'. 

In the sum for S in equation (3), we may in particular take & = x,*, in 
which case the sum is 

S- if(xi)S<, (61) 

1 

or, if we write Ax* in place of 5 t = x; — x^i, a difference of two values 
of x, 

8 = kf(xi)Axi. (62) 

t»i 


This is the form which gave rise to the notation for an integral, 
dx } the sign of integration being a modified S, and the replace¬ 
ment of the Greek letters 2 and A by the Latin letters S and d indicating 
that we have performed a limiting process. This is analogous to replac¬ 
ing A by d to indicate that dy/dx is obtained from Ay/ Ax by a limiting 
process. 

The limits a and b are analogous to the initial and final values of the 
index of summation. As we have replaced x t by x, the index of summa¬ 
tion i no longer appears, but the variable x itself plays an analogous r61e. 
In fact, if we considered the function f(u) for values of u such that 
a S u g* 6, we could carry out the entire process of section 121, regarding 
the Xi as intermediate values of u. Thus we should find the same values 
for the sums S and St and the same limiting value 7. 

This shows that the variable of integration is a dummy variable and 
may be replaced by any other letter. That is: 





7 


(63) 
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The value of the integral depends on the choice of the interval of inte¬ 
gration, that is on the values of a and b. Hence for a fixed function 
t(x ), the integral is a function of the limits. 

In particular, we may keep the limit a fixed and replace 6 by a variable 
quantity x. The integral then becomes a function of x : 


A(x) = j*f(x) dx — fm du. 


(64) 


In the first integral written, x is used in two senses, both as a variable 
limit, and as the dummy variable of integration. When we replace the 
dummy variable x by w, we do not affect the x used as a variable limit. 

We note that, since /(x) is bounded, the function A (x) is a continu¬ 
ous function of x. We have, in fact: 


r +h 

f(u) du = Kh, 


(65) 


where K lies between the upper and lower bounds of f(x). Thus, if 


f/(x)| ^M, -M ^K^M, and \Kh\ g Jlf|A|. (66) 


It follows that when k —»0, l£7i —»0, and A (x + h) —* A (x), so that the 
function A (x) is continuous at x. 

128. Equal Subintervals. The expression (62) may be further 
specialized by taking all the Ax,- equal, so that Ax,- = (6 — a)/n. This 
gives a particular sequence of sums <S„: 


where 


S n - 


£ /(*.) Az», 


»-l 





Xi 


a + 


i(b — a) 
n 


(67) 

( 68 ) 


For integrable functions, we have: 



lim S n . 

n - -fr-foo 


(69) 


This last equation, restricted in its application to continuous functions, 
and interpreted as expressing a property of the area under a curve, is 
sometimes used as a definition in elementary calculus. This approach 
enables one to confine his attention to a single specific sequence S„. 

The values of S n are sometimes calculated in a specific case for a few 
values of n, to suggest that a limit is approached. We may form a 
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precise estimate of the behavior of S n) from the remark at the end of 
section 122, which shows that, 

if -< then |$ n — JJ < tj. (70) 

n 

In simple cases, we may determine <5 0 numerically. Thus, suppose 
that/(x) has a derivative throughout the closed interval a,b and that M 
is any upper bound for f (x) in this interval. Then from the law of 
finite increments of section 74, we have 


so that, 

f(x 2 ) - fix 0 = (x 2 ~ Xi )/'(£), 

(71) 

if 

x 2 — xi g 8 0 and |/'(x)| ^ M, 

(72) 

we shall have: 



l/fe) — /(^i)l 5 MS 0 . 

(73) 

Thus, we can 

satisfy the relations (7) and (8) by taking: 



M8q ^ 

b — a 

(74) 


If we take 5 0 to satisfy this inequality, and then take n to satisfy the 
inequality (70), we shall have: 


2 M(b - a) 2 

n >- 

V 

This proves that: 


(75) 


I/, throughout the closed interval a,6, the function f(x) has a derivative 
f'(x) and M is any upper bound for |/'(x)| on the interval , then , for any n 
such that n > 2M(b — a) 2 /y, the sum: 


n b — a i(b — a) ,_ v 

S n = L/(x») As,*; A Xi =-, Xi = a 4-> (76) 

i 71 n 

approximates the integral I = fm dx to within rj, so that |£„ — J| < ij. 

The conclusion still holds, whether f(x) has a derivative or not, pro¬ 
vided M is such that 


\H.X 2 ) - f(x x )\ < M\x 2 - Xl \, 


(77) 


for all values of x\ and xi in the closed interval a, b. 

The condition (77) is called a Lipschitz condition, and implies that 
the function is continuous and hence integrable. 
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129. Derivatives of Integrals. Let the function fix) be integrable 
on the closed interval a,b and continuous at xq, a point of this interval. 
Then the integral of fix) over the interval a,x is a function of x, and we 
may write as in equation (64): 


A(x) = fm dx = f. m du, 


(78) 


where we have replaced the dummy variable of integration x by u so as 
to avoid confusion between the variable of integration and the variable 
upper limit. 

Let us now calculate the derivative of A (x) at x 0 , using the fundamen¬ 
tal definition. We have for any value of x and x + h in the closed 
interval a,b: 


A(x + h)-A(x) 



+h 

f(u) du — 



du 



du, (79) 


by equation (29). We next deduce from the first mean value theorem 
for integrals that for a suitable intermediate value £, 


£ between x and x + h, or £ = x + 6h, 0 < 6 < 1, 



du = hj(£) = hf(x + 6h). 


This shows that 


so that 


A(x + h) - A{x) 


= /(x + eh), 


A(x 0 + h) - A(x 0 ) ,, . 

hm-r-- /(* o), 

h-+o n 

since /(x) is continuous at xo- 
Thus the function A (x) has a derivative at x 0 , 

and A\x 0 ) = /(x 0 ). 


(80) 

( 81 ) 


(82) 

(83) 


(84) 


We may formulate the result as a theorem: 

If fix) is integrable in some closed interval a,b and if fix) is continuous 
at some point Xq in the open interval a,b, then the function Aix) = 

J!>> dx or Jf/w du has a derivative for x =* Xo> and this derivative 

A'ix o) - fixa). 
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130. Existence of Indefinite Integrals. If the function f(x) is con¬ 
tinuous throughout the closed interval a,b, then the argument of the 
preceding section shows that the function 

A(x) = X /w du (85) 

is an indefinite integral of fix) as defined in section 126, 

since A f {x) = f(x) (86) 

throughout the closed interval. 

The function A (x) is the particular indefinite integral which is zero 
when x = a. The indefinite integral similarly obtained by using any 
other value a ; in place of a is A (x) — A (a 7 ), by the reasoning of section 
126. 

Thus every continuous function has associated with it another func¬ 
tion, its indefinite integral for a particular value of a. For a particular 
function f(x) and a particular value of a, the function A (x) could be 
computed and tabulated. We shall develop practical methods of doing 
this in section 145. Theoretically the values could be found to any 
desired degree of approximation by the method given in section 128. 

131. Inverse Operations. The theorems of sections 126 and 129 show 
that differentiation and integration are to some extent inverse operations. 

For, if we start with an integrable function f(x), integrate it with 
lower limit fixed and upper limit the variable x, and then differentiate, 
we shall come back to the original function for any value at which the 
function/(x) is continuous, by section 129. 

Again, if we start with a function F(x) having an integrable derivative, 
differentiate it, and then integrate it with lower limit fixed and upper 
limit the variable x } we shall come back to a function only differing by a 
constant from the original function, by section 126. 

In particular, when we are dealing with simple explicit functions on 
restricted intervals, all of the functions which come into consideration 
have continuous derivatives. For such functions, integration followed 
by differentiation with respect to the upper limit leaves a function 
unchanged, wfiile differentiation followed by integration with variable 
upper limit changes a function at most by an additive constant. This 
principle, or the more precise result expressed by the theorems of 
sections 129 and 126 paraphrased above, is sometimes referred to as the 
“ fundamental theorem of the integral calculus.” 

In elementary work, where we are interested in explicit expressions, 
we think of differentiation as leading to a simpler result than integration, 
since the derivatives of the functions with which w r e deal can always 
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be found explicitly with comparative ease, whereas the indefinite inte¬ 
grals of many of the functions we meet can not be found in terms of 
functions already known to us. 

However, from another point of view, integration leads to a simpler 
result than differentiation. For, in all the theorems of Chapter IV, we 
had to assume that the functions could be differentiated to yield the 
derivatives involved. On the contrary, if we start with any continuous 
function and integrate it, we obtain a second function as shown in 
section 122, and this function has a derivative. 

Or, if we start with an integrable function, not necessarily continuous, 
and integrate it, the result will be a continuous function, by section 127. 
In fact, equations (65) and (66) show that A ( x ) satisfies a Lipschitz 
condition, as defined in equation (77). 

Thus integration is a smoothing process, always leading to a function 
having at least as much in the way of continuity or differentiability 
properties as the original function. 

132. Tables of Integrals. In some cases the indefinite integral of a 
simple explicit expression can be found as an algebraic expression, or 
can be expreased in terms of functions which are already tabulated. 
Every specific formula of differentiation leads to the determination of 
some indefinite integral. Thus, we obtain such results as 


x n dx = 


n + 1 


/ 

/V 1 dx = log x f etc. 


> n 5* — 1 , 


(87) 

( 88 ) 


Results of this kind are arranged in convenient form as tables of inte¬ 
grals and may always be checked by differentiation. The scope of such 
a table is greatly increased by certain general methods of reduction, to 
which we proceed. 

133. General Reductions. The general rules for differentiation 
given in section 63 lead to corresponding rules for integrals. Throughout 
this section, we shall assume that all the derivatives used exist, and that 
any function used as an integrand, as u or u dv/dx, is continuous. With 
this assumption, we have: 



J * kudx «= k 
/»* / 

J * U dXy 
%x pX 

(89) 

and 

1 (u + v) dx = f 

udx + J v dx, 

(90) 


since both sides have the same derivatives with respect to x. 
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The rule of “ integration by parts,” 


r dv , r x du 

1 u dx — uv — / v — j 

J dx J dx 

(91) 

is proved similarly. This is useful when the integral on 
simpler than that on the left. 

Finally we have the rule of substitution, 

the right is 

A(x) = J f(x) dx = ff{g(t)}g'(t) dt, 

(92) 

* r o 17 to 

where 

zo = g(to), x = 0 (f), 

(93) 

and the function g(t) is a single-valued function for the closed interval 
t 0) t. 

We prove this rule by differentiating both sides with respect to t. 

For the left side, A = 1 f(u) du, we find: 

■ JO 


dA dA dx „ . v 

S " * 5 " mg (1) > 

(94) 

and for the right side, B = / f[g(u)]g'(u) du, we find: 


~ = f[g(t)]g'(t), 

(95) 


by section 129. But the expressions (94) and (95) are equal, in view of 
the equation (93). 

That the integrals A and B do not differ by a constant follows from the 
circumstance that x = x 0 when t = t 0 , so that both integrals in equa¬ 
tion (92) are zero when x = x 0 . 

The rule of substitution for indefinite integrals may be written in the 
form: 

f fix) dx = / MWit) dt, ( 96 ) 


where the limit x = gif) and this function is single-valued for the range 
of f to which the equation is to be applied. This is a consequence of 
equation (92). It is easily remembered, since if x — g(t), the differential 

do 

}{x) dx - f(g) dg = f(g) — dt, and the value of t corresponding to x is 

dt 


such that x = g(t). 
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134. Separable Differential Equations. A relation of the form 


dy 

dx 


F(x,y) 


(97) 


is called a differential equation of the first order, and any function 
V — /(*) is a solution of this equation 

if f{x) = F[x,f(x)}. (98) 


The differential equation is said to be separable if the function Fix,y) 
may be written as the quotient of a function of x alone by a function of 
y alone, so that 


dy 

dx 


p(aQ 

qiy) 


and qiy) dy — pix) dx, 


(99) 


an equation involving differentials in which the variables are separated. 
We assume that qiy) and pix) are continuous. 

Let us next assume that the equation (99) has a solution y = fix), for 
a; in a certain range Xi, and that for x in this range qlf(x)} is 

never zero. Then, if y 0 — /(x 0 ), and y = fix), the rule of substitution 
in the form of equation (92) shows that 


But, if we define 


J qiv) dy = f pix) dx. 

Vo ** *0 

My) = J qiy) dy, 


( 100 ) 

(ioi) 


in the range considered this function has a derivative qiy) which is 
never zero. Hence, by section 75, it has a uniquely determined inverse 
function, and the equation 

fix) = A~ l [ fpix) dx] (102) 

defines a function f (x). 

If, then, we start with the equation (99) with p(x) and qiy) continu¬ 
ous functions, restrict y so that in the range y 0 ,y the function qiy) is never 
zero, and form the equation (100), this equation will determine y as a 
function oi x,y = fix). 

Since this function is given by equation (102), by sections 75 and 129 
we have: 
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Moreover, we see from equation ( 102 ) that when x = Xo, J/ = !/o> so 
that/i(xo) = 2 /o- This shows that y — fi(x) is a solution of the defer¬ 
ential equation (99), which is y 0 when x = x 0 . Since this function 
was uniquely determined by equation ( 100 ), and any solution of this 
kind necessarily satisfied equation (100), it is the only solution. That is: 

If the functions p(x) and q(y) are continuous, the solution of the separable 
differential equation 


dly _ p(x) 
dx q(y) 


(104) 


which equals yo when x — x 0 , is uniquely determined by: 

f q(v) dy = r p(x) dx, (105) 

**Vo ^*0 

provided that q(y) is never zero in the closed interval yo,y. 

This justifies the solution of separable differential equations by separ 
rating the variables and integrating between corresponding limits. 

135. Complex Notation. If IF(x) is a complex function of a real 
variable, as defined in section 119, whose derivative for real increments 
is w(x), we call W(x) an indefinite integral of w(x) and write: 



dx = W(x). 


(106) 


By section 119, dW(x)/dx = w(x) if, and only if, 

- 7 -RTF(:r) = Rw(x) and lW(x) = Iu>(x). (107) 

dx dx 


Thus the equation (106) is completely equivalent to the two real 
equations: 



dx * Rif (x) 


and 



dx = IW(x). 


(108) 


The integration of certain functions is simplified by regarding them as 
the real or imaginary part of a complex function of a real variable. For 
example, from 

e (a+bi)r __ € ax CQg fa feax g J n fa> (109) 

/ x Aa+bi)x 

e {a+bi)x dx - ——. ( 110 ) 

a + bi 

we may deduce: 

/ * ■ , e“(a cos bx + b sui bx) 

e* cos bx dx = -- 


(111) 
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and 



sin bx dx — 


e“(o sin bx — b cos bx) 
a 2 + b 2 


( 112 ) 


136. Known Integrals. We may use the rule of substitution of 
section 133 to show how the ease or difficulty of evaluating an integral 
depends on our previous knowledge. Thus, suppose that for any func¬ 
tion f(x), continuous and positive on the closed interval a,b, we have 
already calculated and tabulated the function 


A (x) = J' /(x) dx 


(113) 


erf section 129 for a large number of values of x on this interval. Then 
this function, A (x), will be a known function in the sense that the func¬ 
tion logio x is known for values of x on the interval 1,10. 

As we have assumed that/(x) is positive, by section 129, A'(x) = f(x ) 
is positive. Hence, by section 75 the function y = A (x) has an inverse 
function x — A~ l (y) whose derivative is 


so that 


d 


1 _ 1 
A'(x) “/(x)’ 


lA~'(y >]' 


l 

f[A~Hy)] 


(114) 

(115) 


The inverse function x = A -1 (y) may be read from our table for A (x) 
if y is in the interval A (a),A (b), just as we read the values of 10*', the 
number whose logarithm is y, from a table of logarithms for values of y 
in the interval 0,1. 

Now suppose that we have either forgotten the origin of the function 
A(x) which appears in equation (114), or that we have derived this 
property of the function from some other definition. In any case we 
recall the function and the equation (115), and try to use it to evaluate 

the indefinite integral J* /(x) dx. Let us transform this by the rule of 

substitution, equation (96), with 

x = g(t) = A _1 (0> bo that t - g~ l (x) — A(x). (116) 


Then, from this and equation (115), 


g'(t) 


IA-W 


l l 

flA-Ht)) “/[?«)]’ 


(117) 


so that 


MWit) - 1 . 


(118) 



Art. 137 ] 


RATIONAL FUNCTIONS 


213 


As this is the second integrand in equation (96), we have: 




dt = t = g 1 (x) = A(x). 


(119) 


We have thus reduced the indefinite integral j* f(x) dx to a known 
function, A{x). 

While this process seems unnecessarily roundabout and highly artificial 
when stated in general terms, it is essentially the process used to reduce 



and 



dx 

1 + x 


2 


tan 1 x 


( 120 ) 


to known functions in elementary calculus. In fact, the best methods of 
computing tables of these functions are based on expansions directly 
derived from the properties: 


d , Id, 1 

-log*- x , (121) 

analogous to the property A f (x) = /(x). Compare problems 31 to 35 
of Exercises IV. 

137. Rational Functions. To integrate a rational function with real 
coefficients, we use the decomposition of section 115. We showed there 
that any rational function of x could be reduced to the quotient of two 
polynomials in x, A(x)/B(x), where A(x) and B(x) have no common 
factors. Furthermore, the function could be expressed as the sum of a 
polynomial and terms of the form A n (x — b )~~ n , there being a series of 
such terms with n = 1, 2, • • *, r for each real or complex root b of the 
denominator B(x) } where r is the multiplicity of the root. A rational 
function with real coefficients may be reduced to the quotient of two real 
polynomials. Since any common complex roots will occur in conjugate 
pairs, they may be removed by dividing by real factors, and we may 
assume that A (x) and B(x) have real coefficients. Thus the function is 
a real rational function as defined in section 118, and in the decomposi¬ 
tion the coefficients of the polynomial, as well as the A „ for any real 
root 6, will be real. Conjugate complex roots will have the same 
multiplicity, and will give rise to terms with conjugate coefficients. 

The integration of the rational function is deduced from the integrals 
of the separate terms of the decomposition by equation (90). For the 
terms of the polynomial we use: 

J kdx**kx and j kx m dx~— — > m = 1,2, 3, • • • . (122) 
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The equations: 


/ A dx 

^ = A log \x — 61 and 

/ A dx —A 

(x - b) n ~ (n - l)(x - 6) n_1 ’ n 


J (x- b) n (n - l)(x - 6)"’ 1 ' ” 2 ’ 3 ’' " 

give the integrals for the terms for real roots. 

For the terms arising from complex roots, we note that: 

A + Bi A — Bi A + Bi 

(x — a — bi) n (x — a + bi) n (x — a — bi) n 

if a, b, A, and B are all real numbers. By equation (108) we have: 


*2R A + B * dx 
(x — a — bi ) 


— 2 A + Bi 

- -- R - — ——r > n = 2, 3, 

(n — 1) (x — a — bi) 1 


/ * A A- Bi 

2 r - ^——.dx = 2R [(A + Bi) log (x - a - bi)] (126) 

x — a — bi 

where the relations of the derivatives to the integrands follow from 
section 112. 

We may obtain other expressions for the integral (126), since 
2R[(A + Bi) log (x — a — bi)] 

= 2 A log \x — a — bi\ — 2 B arg (x — a — bi) 

— log \x — a — bi\ 2A — arg (x — a — bi) 2B (127) 

- A log [(x - a) 2 + b 2 ] + 2 B tan" 1 ~— ■ (128) 

X CL 

The form (127) enables us to write the sum of a number of such terms 
with a single use of the symbols log and arg, thus theoretically enabling 
us to find the value of any rational integral with only one use of the 
logarithmic tables and one use of the trigonometric tables, since the 
terms involving logarithms from real roots may be written log |x — 6| A . 
Since 


tan 1 u = cot 1 - = x — tan 1 - > 
m2 m 


we have 


2 B tan" 




-22? tan - 




+ Bjt. 
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If we make this substitution and absorb the constant Bv in the constant 
of integration, we may deduce from the form (128) that 

f 2R - A + dx = A\og[(x-a) 2 + b 2 ]- 2 B tan" 1 • (131) 

J x — a — bi j) 

This last form is the most familiar, and usually the one best adapted 
to computation. 

If we expressed the integral as a real function, we should write: 

* P + Qx 
x 2 + px + q 


Thus even the real form of the integrated expression has constants 
more closely related to the form of the integrand (131) than to the form 
of the integrand (132). 

The advantage of using the decomposition of section 115 over using 
that of section 118 is slight for simple conjugate complex roots, but is 
much greater when there are multiple complex roots. In that case, for 
multiple quadratic factors we must develop reduction formulas, which 
essentially take us back from the real coefficients P 3 and Q v appearing 
in numerators P 3 + QjX, to the original conjugate complex numerators, 
A y ± Byi. That the reduction formulas must do this may be seen from 
equation (125), which shows that, in complex form, each pair of terms of 
a given degree taken by itself has a simple integral. 

Since the coefficients in the decomposition are determined, they may be 
found either by the method of undetermined coefficients, the method of 
section 116, or by using the fact that an identity must be true for any 
values of x, conveniently chosen. The work may sometimes be short¬ 
ened by subtracting the development up to a certain stage. 

For example, if a third degree denominator has one real root and one 
pair of conjugate complex roots, we may determine the term for the real 
root by equation (244) of section 116, and subtract the polynomial and 
the fraction for this root to obtain a term like that in equation (132). 

Again, if a denominator has one multiple real root and a number of 
simple real roots, we may subtract the terms for the simple roots, as 
well as the terms of the polynomial, and then determine the terms for the 
multiple root by expanding the resulting numerator in the appropriate 
Taylor’s development. 

Another method of determining the integral is to use the reasoning of 
this section to predict the form of the integral, except for the coefficients, 



Q 

2 log (x 2 + px + q) 


Qp t ~i 2x + p 
= tan 1 ~ 7 ====-= 
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and then directly determine the coefficients of the integral by the method 
of undetermined coefficients. 

138. Rationalizable Integrands. Several other classes of integrals 
may be reduced to integrals of rational functions. To describe some of 
these classes, we shall denote a rational function of one variable, u } by 
R(u ), and a rational function of two variables, u and v, by R(u,v ), so 
that this last is the quotient of two functions, each a polynomial in the 
two variables u and v. 

/ r ax + ?n 1/a \ 

Then the integrand R j J is rationalizable when q is an 

integer. For, if ad — be = 0, the second variable is a constant, and the 
integrand is already a rational function of x. When ad — be ^ 0, the 
rax + 61 

relation -■—- = t makes x a rational function of t, g(t). Thus 

L cx + a J 

g*(t) is rational, and the new integrand obtained from equation (96), 
iR\g(t) y t]g\t) is a rational function of t. 

An important special case is R(x f Vox + b). 

Again, the integrand R (e ax ) is reducible by the substitution ax = log t f 
to the integral of 12 (£)/«*, which is a rational function of t. 

Any rational function of trigonometric functions of x may be 
written in the form R (sin x, cosx). An integrand of this type 


may be reduced by the substitution t 


tan - to the integral of 


/ 2 1 1 - t 2 \ 2 

I i -—-— 5 » -—-—^ J -—-— 5 » which is a rational function of t. 

\1 + r 1 + < / 1 4- r 

We may always rationalize an integrand of the form 


c 2 + bx + c). 


We assume a ^ 0 , since the integrand with a = 0 is of a type already 
discussed. 

If the roots of ax 2 + bx + c — 0 are p and q, real and unequal, we 
may write ox 2 + bx + c = a(x — p)(x — q). If we put a(x — p) = 
< 2 (x — ?), x = g(t) is a rational function of t, so that g'(t ) is also rational. 
The transformed integrand is R\g(t),t[g(t) — q]\g'(t), which is rational 

in t. _ 

When the roots are equal, q = p, Vox 2 + bx + ~c = y/a(x — p), so 
that the integrand is rational in x. In this case a must be positive, 
since the integrand is assumed to be real. 

When the roots are conjugate complex numbers, r ± is, 

as? + o(x — r — ia)(x — r + -is) =* o[(x — r ) 2 + s 3 ], (133) 
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and again a must be positive in order to make the radical real. In this 
case we put (x — r) 2 + s 2 = [(x — r) + t] 2 , which makes x = g(t) a 
rational function of t, so that g'(t) is also rational. The transformed 
integrand is R[g(t),g(t) — r + t]g'(t), which is rational in t. 

139. Other Elementary Integrals. Let / (u) be an inverse trigono¬ 
metric function, an inverse hyperbolic function, or the logarithm (inverse 
exponential function). Let B'(x) be the derivative of an explicit alge¬ 
braic function, B{x) } and let A(x) also be an explicit algebraic function. 
Then the integrand I[A(x)]B f (x) may be simplified by an integration 
by parts: 

J I[A(x)]B'(x)dx = I[A(x)]B(x) - j' X l'[A(x)]A'(x)B(x)dx. (134) 

The new integrand, l'[A ( x)]A'(x)B(x), is an explicit algebraic expression 
and may be rationalizable if the functions A (x) and B(x) are sufficiently 
simple. 

In particular, if A(x) = x and B(x) is a rational function, 
the new integrand I f (x)B(x) will either be rational, or of the form 
Rixy^/ai 2 + bx + c), which is rationalizable. Thus an inverse func¬ 
tion of x times a polynomial may be integrated by this process. 

The problem of integrating a real polynomial in any number of vari¬ 
ables, each of which is either x, an exponential e ax } or a sine or cosine 
function sin bx, cos cx, is immediately reducible to the problem of inte¬ 
grating terms of the form x n e Ax , where n is a positive integer, and A is a 
real or complex number. When A is complex, the indefinite integral is 
to be understood in the sense of section 135. An integration by parts 
may be used to reduce the exponent of n by unity, 

/ * p Ax w n x 

x n e Ax dx — x n — -- J x n ~ 1 e Ax dx, (135) 

so that n such integrations will reduce the problem to 



Our purpose in the last three sections is to give the student some 
general idea of the classes of integrals which either will be found in inte¬ 
gral tables or may readily be reduced to integrals given in the tables. 
The general methods here given are often much longer than special 
devices adapted to particular cases or to the construction of a table of 
integrals. Also there are a number of alternative procedures which are 
sometimes preferable. For example, if the form of the integral is pre- 
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dictable to within a number of constants, these may be found by the 
method of undetermined coefficients. 

Any indefinite integral taken from an integral table may be verified 
by differentiation, which always provides the simplest proof of such a 
formula if the answer is known. 

140. Non-elementary Integrals. Most integrals not of the types 
discussed in the last three sections nor immediately transformable into 
one of these types cannot be evaluated in terms of a finite combination 
of elementary functions. In a few special cases, the non-elementary 
character of an integral has been proved, by showing that the function 
defined by the integral with variable upper limit has some property 
not enjoyed by any elementary function. The character of the argu¬ 
ment is somewhat similar to that given in section 92 to prove that the 
logarithmic function is not an algebraic function. 

A few of the simpler non-elementary integrals are those with inte¬ 
grands, e*/x, sin x/x, cos x/x, which lead to new functions known as the 
exponential integral, the sine integral, and the cosine integral. The 
integrals 



f 


sin i 2 dx, and 



cos x 2 dx 


(137) 


are known as the probability integral, the Fresnel sine integral, and the 
Fresnel cosine integral. We shall discuss practical methods of construct¬ 
ing tables of these functions in section 331. Such tables are available 
and enable us to evaluate these integrals and any others easily reducible 
to them. 

The simplest algebraic integrands wh ich in general lead to non-elemen¬ 
tary integrals are those given by R[x,\ P(x)] where P(x) is apolynomial 
of the third or higher degree, and ft is a rational function of the two 
variables as in section 138, where we showed that this integral was 
elementary if P(x) was of the first or second degree. 

Since the square root of a polynomial with multiple roots may be 
written as a polynomial times the square root of a new polynomial with 
all its roots simple, we may, and shall, assume that all the roots of P{x) 
are ample. When the polynomial with simple roots is of degree three 
or four, the integral of ft[x, VP(x)] is called an elliptic integral. 

141. Elliptic Integrals. The special elliptic integrals 

_ (*** _dx_ 

Vl — k 2 sin 2 <t> V (1 — x 2 ) (1 — k 2 x?) 

yj'? : 0 < k < 1 , (138) 
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the elliptic integrals of the first kind, and 

r - pain 4> a/- i _ jl 2 t 2 

Vl — fc 2 sin 2 <j> d<t> = I - —-rrs::" Y- I 

Jq 


0 < fc < 1, (139) 

the elliptic integral of the second kind, have been tabulated by Legendre 
for real values of fc between 0 and 1 . 

The elliptic integral of the third kind, 


= f 77 

(si 


(sin 2 4> — a) Vl — k 2 sin 2 <j> 


Jo (x 2 ~ a) V(1 - x 2 )(l ~ fc 2 # 2 ) 

where fc is real, 0 < fc < 1 , and a may be complex, has been only par¬ 
tially tabulated. 

We shall now prove that: 

If P(x) is a polynomial of at most the fourth degree with real coefficients 
and if R is a rational function of two variables with real coefficients } while x 
is restricted to a range in which P(x) is positive , the indefinite integral 

J X R[x,V¥(x)} dx can be expressed as a linear combination of terms, 

each of which is either an elementary function , or an elliptic integral of the 
first , second 7 or third kind . 

As was indicated in the preceding section, the integral is rationalizable 
if P(x) is of the first or second degree, or has multiple roots. 

When P(x) is of the third degree it has at least one real root, r, and 
we may write: 

P(x) = (# — r)(ax 2 + bx + c), a ^ 0. (141) 

Thus, for a range of x such that x > r, we may make the change of vari¬ 
able x *= r + z 2 , dx « 2z dz . The radical becomes: 

VP(x) » z Vas 4 + (2ar + b)z 2 + ar 2 + br + c = z VQ{z). (142) 

Hence the new integrand is of the same type as the old, but the new 
radicand involves no odd powers. For a range of x such that x < r, we 
put x = r — z 2 . We note that in either case, 

dx _ 2 dz 

VPM ~ VOM 


(143) 
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Finally, let us assume that P (x) is a fourth degree polynomial without 
multiple roots. It may be factored into two real quadratic factors: 

P(x) = a(ac 2 + px + q)(x 2 + p'x + q'), a j* 0 . (144) 

We wish to reduce this to a form where p and p' are zero, and attempt 
to do this with a linear fractional transformation: 


r / + SZ 

x =-- 

1 + Z 

This will make 

(x 2 + px + q)( 1 + z) 2 = Az 2 + B, 

(x 2 + p'x + <?')(! + z ) 2 = A'z 2 + B', 
if 

2/fif + p(f + g) + 2 g = 0 and 2fg + p'(f + g) + 2 q' = 0 . (147) 
When p p', these relations are equivalent to 

/+ff- 2 -V 1 ^ and fg = (148) 

p - V V - V 

which may be solved with real values of / and g if 
o <\{f - g?{p' - P? 

or (q - q') 2 - (p'- p)(pq'- qp') > o. (149) 


(145) 

(146) 


Let us now put 

x 2 + px + q — (x — t)(x — r) 

and x 2 + p'x + q' = (x — r')(x — ?')• (150) 


Then the expression just written becomes: 

(r? — r'f') 2 — (r + f ~ r' — f’)[rf(r' + f') — r'f'(r + f) J. (151) 


But this may be written 

(r — r')(r — r')(f — r')(f — f'), (152) 

since it vanishes when r = r', and so admits the factor r — /, and the 
other three factors by symmetry, and finally is a fourth degree poly¬ 
nomial with the term r 2 ? 2 , so that the multiplicative constant is unity. 

If both quadratic factors have complex roots, r and ? are conjugate 
complex quantities and so are r' and Thus the first and fourth, and 
the second and third factors, are conjugate and so have a positive prod¬ 
uct. Again, if r and f arc conjugate, and the other two roots are real, 
then the first and third factors are conjugate, and so are the second and 
fourth, finally, if all four roots are real, we may take the two algebrai- 
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cally greatest roots as r and r, and all four factors will be positive. No 
factor can be zero, since our fourth degree polynomial has distinct roots. 

Thus, if V ^ v' we may find real values of / and g such that the 
rational transformation (145) makes 

Vpm V^ + BK^V + g') VOW 

U (1 + Z ) 2 (1 + z ) 2 <153) 

From the relation (149), g f, and we note that 

dx . dz , . 

—/ -= (g —f) - 7 = • (154) 

Vp(x) Vq(z) 

When p = p , we put x — z — dx — dz, which makes 
P(x) = a{x 2 + px + q)(x 2 + px + q') 

= a (z 2 + q - £\ (z 2 + q' - ^ = Q(z), (155) 


, dx dz _ __ 

and • " 7 .- = —== • (156) 

Vp(x) VQ(z) 

Our discussion shows that the integral of R[x,P(x)] is either ration- 
alizable or reducible by real substitutions to the integral of a similar 
expression with 

P(x) = {Ax 2 + B){A'x 2 + B'), (157) 

where A, B, A', and B' are all real. 

We observe that, if the radicand of equation (142) does not have real 
factors of this form, it may be factored and transformed by the process 
used for the P(x) of equation (144). 

142. General Reductions. We assume the radicand has the form 
given in equation (157), and proceed to certain methods of simplifying 
our problem. While it is logically simpler to use this order to avoid 
unnecessary repetition, practically it is preferable to apply these general 
reductions before transforming the radicand. This may greatly amplify 
the formal work, even if the reductions have to be applied again to some 
of the terms after the radicand is transformed. 

Let us denote P (x) by v 2 , so that the integrand is R (x,v). By using the 
identities 

v 2n = (t> 2 )" = [P(x)] n , v 2n+1 = t>[P(x)] n , (158) 

we may express the integrand in the form 

K + Lv 
M + Nv’ 


(159) 
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where K, L, M, N are polynomials in x. Now rationalize the denomina¬ 
tor, 

(K + Lv)(M - Nv ) _ KM - LNv 2 + (LM - KN)v 

(M + Nv)(M-Nv) M 2 -N 2 v 2 ’ (160) 


and replace v 2 by P (x). This reduces the integrand to the form U + Vv, 
where U and V are rational functions of x. 

Since U is a rational function, we need only consider integrands of the 
form: 


Tr Vv 2 W 
Vv =-= —» 

V V 


( 161 ) 


where W is a new rational function of x. 

The rational function W can be decomposed into a polynomial and a 
number of partial fractions, which reduces the integral to a sum of terms 
of the two forms: 

(a) On f — dx, and (b) b n f ——-—— dx. (162) 

J v v \X — r) 

There will be terms of the second form, (b), for each real or complex 
root, r, of the denominator of W. 

In order to reduce these integrals (b), we observe that: 

d f v w'(x — r) — mv 2 _ |P'(x)(x — r) — mP(x) 

dx [.Or ~~ r) m J (x — r) m+l v (x — r) m + l v 

c 4 (x - r) 4 + C 3 (x - r ) 3 + c 2 (x - r) 2 + Ci(x - r) + c 0 
- <x - < 163 ) 

since the numerator, a fourth degree polynomial, may be expanded in 
powers of (x — r). By integration, we find from this that 

v I* f x dx /** dx 

(x - r) m b, ~ C4 v(x - r) m ~ 3 ° a v(x - r ) m ~ 2 

+ c> ^^^r^ + c ‘X' _ (^r + c “X-(*-ir 35 ' <164) 

If Co f 4 0, this relation may be solved for the last integral to give a 
reduction formula by which an integral of type (b) with n = m + 1 
may be expressed in terms of an algebraic function and four integrals of 
type (b) with n = m — 3, m — 2, m—1 and m. 

If Co «= 0, and m 7 * 0, it follows from equation (163) that P(r) = 0. 
Hence P*(r) & 0, and c\ 9* 0. In this case the relation (164) may be 
solved for the integral of type (b) with » * m to give a reduction formula 
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by which such an integral may be expressed in terms of an algebraic 
function and three integrals of type (b) with n - m - 3 , m - 2 and 
m — 1 . 

In any case, by starting with the integral of type (b) for a given root 
for which n is largest and, at each stage, combining together all the 
integrals with the same power of (x — r), we may reduce all the inte¬ 
grals of type (b) for a given root r to the integrals: 



1 

(x — r)v 


dx, 



J x (x - r) 2 


(165) 


The last three integrals may be combined with the integrals of type (a) 
of (162). The first integral may be written: 

/V—<*«- /-•+'* 

J (x - r)v J (x 2 — r 2 )v 

/ x x dx C x dx 

J (x 2 - r 2 )v' (166) 

If we make the substitution r 2 = z, wc find: 

f x xdx _ _ _ dz _ 

J (x 2 - r 2 )v J 2{z - r 2 )VjX7^ni){AV+W)’ ^ 


which is a rationalizable integral. This shows that we need only con¬ 
sider, in addition to integrals of type (a) of (162), integrals of the form: 




(168) 


We next consider the reductions of integrals of type (a). 
r = 0, m = — M, equation (163) may be written: 


(x M v) 


dx 


d A x M+3 + d 2 x M+l + d 0 x‘ 


M -1 


If we put 


(169) 


since P(x) and hence P'(x)x contain no odd powers of x. For M > 0 , 
^ 0, since = (2 + M)AA’. Tliis equation leads to a reduction 
formula by which an integral of type (a) involving x Jtf+3 can be reduced 
to two other integrals of the same type involving the exponents M + 1 
and M — 1 . 

We only apply this for odd values of M, when all the exponents in the 
integrals are even, since for odd exponents the integrals of type (a) are 
rationalizable. In fact, if x 2 = z, 


r*x 2n+1 . r‘ _ 

J v J 2V(A 


z n dz 


z + B)(A'z + B') 


(170) 
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By repeated reduction of the integrals with even exponents, starting 
with the term with highest exponent, we may reduce the integrals of 
type (a) to the two: 



and 



(171) 


Thus our problem is now reduced to integrals of three types, the two just 
written and those of the form (168). 

143. Transformations of the Radical. We must now develop real 
substitutions which will transform the radicand 

v 2 = P( X ) = (Ax 2 + B)(A'x 2 + B') (172) 

into that of the standard forms, 

(1 — x 2 )(l — k 2 x 2 ) with k < 1 . (173) 


Since P(x) is positive, we may so select the signs of the constants that 
both factors Ax 2 + B and A'x 2 + B' are positive. Since all the roots 
of P(x ) are distinct, a real range for which P(x) is positive can not 
include a root of P(x). Hence neither of the factors can change sign in 
the range. 

We next consider two special substitutions. The first is: 

z 2 = Ax 2 + B, z> 0, (174) 

which makes: 

dx dz 

.7= = = -.-. = -== . .=-— > (175) 

V (Ax 2 + B)(A'x 2 + B') V(z 2 - B)(A'z 2 + AB' - A'B) 


the factors on the right being positive if A > 0 . 
The second substitution is: 


1 

z — -» 

X 

which makes 


dx _ dz _ 

(Ax 2 + B)(A'x 2 + B 7 ) ~ V(Bz 2 + A)(B'z 2 + A') 


(176) 

(177) 


If B and B' are both negative, A and A' must both be positive, and 
the second transformation just made leads to a form in which the new 
values of B and B' are both positive. 

If one, say B, is negative and the other, B', is positive, the first 
transformation (174) leads to a form in which the new values of B and 
B' are positive if (AB' — A'B) > 0 . But, since the factors are posi¬ 
tive, for some values of x we have: 

Ax 2 > -B and B' > -A'x 2 


(178) 
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and hence, since — B and B' are positive, 

AB'x 2 > —BB' > A'Bx 2 , so that AB' > A'B, (179) 
and the condition is satisfied. 

Thus we obtain a form in which B and B' are both positive, and we 
may factor them out without changing the signs and so write the radical 
in the form: 

V(1 + Ax 2 ) a +A'x 2 ). (180) 

If A is negative, and A' positive, the first transformation (174) reduces 
the radical to _ 

V (1 - z 2 )(\A' -A]- A'z 2 ), (181) 

where the signs of the factors are the reverse of those in equation (175) 
since A is now negative. In the new form A and A' are both negative. 

If A and A 9 are both positive, the first transformation (174) reduces 
the radical to: 

\V - 1){A'z 2 +[A - A’]), (182) 

and we may choose the notation so that A f > A. If we then apply the 
second transformation, (177), we shall reduce the radical to: 

V (1 - Z 2 )(A' - [A’ - Atf). (183) 

Thus, in the reduced form for the radical given by the expression 
(180), either A and A' are both negative, or we may make them both 
negative by an appropriate combination of the two transformations. 
We need therefore only consider radicals of the form: 

V (1 - aV)(l - b 2 x 2 ), a 2 > b 2 , (184) 

and if we make the transformation 


we shall have: 


ax = z, a > 0 , 


_ dx _ 

V (1 - a 2 x T ) (1 - b 2 x 2 ) 



(185) 

(186) 


The discussion shows that by combinations of transformations of the 
three types (174), (176), and (185) we may take integrals of the type 



into others of the same type, in which v 2 has the standard form 


(173) times a constant factor. 

For a range, or portion of a range, including no positive values, we 
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may put 2 = —x, which leads to a new range including no negative 
values. Thus we may assume both limits positive or zero, and, since 
the integral over *x ,®2 is that over 0 ,^ minus that over 0 , 21 , we may 
assume the lower limit 0. The positive upper limit is less than 1, since 
the factor (1 — x 2 ) is positive. Hence if we put x = sin <f>, we may take 
4> in the first quadrant and write: 

r dx r* a87) 

*A> V(1 — x 2 ) (1 — A 2 a: 2 ) •'o V 1 — & 2 sin 2 <t> 

the standard form for the elliptic integral of the first kind. 

The transformations (174) and (185) do not essentially change inte¬ 
grals of the form (168), merely replacing the radicand by one of the 
standard form (173), and introducing a constant factor and a new con¬ 
stant in place of r 2 . However, the transformation (176) makes: 

/ * dx 1 P* z 2 dz 

,_i/*_(/*_. (UB) 
rJ "‘ rJ 

This is a combination of the first form, already disposed of, and an inte¬ 
gral essentially of the form (168). Thus we need only consider integrals 
of the form (168) with radicands in the standard form (173). As before, 
we may assume the lower limit 0 and the upper limit positive and less 
than 1 . Putting x = sin <£ we find 

r dx r* d<t> 


dx r 

- r 2 )v ~ J 


(sin 2 <j> — r 2 ) V 7 ! 


k 2 sin 2 </> 


which is the standard form of the elliptic integral of the third kind. 

/ * x 2 dx 

—-— These 

are replaced by a constant times an integral of the same type, by the 
transformation (185), and by a combination of one of the same type and 
om erf the first form by the transformation (174). The transformation 
(176) leads to an integral of the third kind, (189), with r = 0 . When we 
do not use the transformation (176), or use it twice, we obtain a new 
integral of the form we started with, with the radicand in the standard 
form (173). We then write: 


r>~hr- 


i r~ 

k 2 J v 
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The last integral written is of the first form. For the other integral, we 
assume the lower limit 0 and the upper limit positive, put x = sin <j>, 
and write: 

(i9i) 


This is the standard form for the elliptic integral of the second kind. 

This completes the proof of the theorem stated in section 141. 

144. Elliptic Integrals of the First Kind. We note that the trans¬ 
formations used may change an integrand of the form x 2 /v, where 
v 2 = P(x) is any polynomial of the fourth degree, into a combination of 
standard elliptic integrals involving all three kinds. In particular, this 
will generally be the case when the linear fractional transformation (145) 
is used. 

However, as we noted, each transformation takes the differential 
expression dx/v into another expression of this same form. This proves: 


An integral of the form f*dx/V¥(x), where P(x ) is a real polynomial 


of the third or fourth degree , ivith no multiple roots , can always be reduced 
to an elliptic integral of the first kind. 


In particular, the integral 



dx _ 

- 92X ~ 93 



_ dx _ 

— €i)(x - e 2 )(x - e 3 j 


ei -j- e 2 -j- e 3 = 0 


(192) 


is of this form. We shall show in section 170 that this integral approaches 
a limit as x —► + «. Thus we may write the integral as u(x ) — u(a), 
with the constant so determined that u(x) 0 as x —> + «>. The 
inverse of this function u(x), the Weierstrass $> function, plays an 
important r61e in the theory of elliptic functions. These are functions 
related to the functions inverse to those defined by certain elliptic 
integrals. 

In many problems of mechanics, the solution is given in the form 
s = J* dx/y/P(x) t where P(x) is a cubic. In this case, if the three 

roots of P(x) are a%, a 2 , and a 3 , and 

<i\ + <*2 + a 3 » 36, $ « s 0 when t « t 0i (193) 


we may write the relation as 

i » b + (s — c), 


(194) 
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where c is defined by P («o — c) — to — b, and is formed with roots 

ei = a t — b, e 2 - a 2 — b, e 3 — a 8 — b. (195) 

While this does not lead to a numerical evaluation, it does express the 
solution in terms of a function whose properties have been extensively 
studied. 

145. Numerical Integration. We shall develop two formulas for 
obtaining an approximate value of an integral when the integrand is a 
specific function whose values can be calculated. These formulas are 
practically useful when the integral either can not be easily expressed in 
terms of functions already tabulated, when the procedure for doing this 
is long, or when it leads to a complicated final expression. 

We obtain these approximations by replacing the integrand in the 
whole or a part of the interval of integration by a simpler expression, 
and by integrating this latter expression. For example, if we replace 
any integrand f(x) by a first degree function taking the same values at 
a and b, or 


o — a 

(196) 

we find: 


£g(x)dx^^~ lf(a)+f(b)], 

(197) 

as an approximation to 

/%b 


J f(x)dx. 

(198) 


If the function f{x) is continuous, it has an indefinite integral F{x), 
for which 

/(*) = F'{x), (199) 

and 

jT f(x) dx = F(b) - F(a). (200) 

Thus the error E, or correction term to be added to the approximate 
value (197) to give the correct result, is: 

E = F(b) - F(a) - h -^ [/(a) + f(b)). (201) 

If t&t function f(x) has a second derivative throughout the open 
intefl^il<i,& we may obtain another expression for E. To do this, put 

A 

b — a * 2 «, a + b — 2c, so that a — c — u and 6 = c + u. (202) 
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From this and equation (199) we have: 

E - F(c + u) - F(c - u) - u[F\c + u) + F'(c - u)]. (203) 
We then proceed as we did in section 91. We define the constant 


and then consider the function: 

<?(*) - F(c + x) - F(c - x) - x[F'(c + x) + F'(c - *)] - Xx 8 . 

(205) 

This function is zero for x = u, by the two preceding equations. It 
evidently is zero for x - 0. Hence by Rolle’s theorem its derivative 

G'(x) = -x[F"(c + x) - F'\c - x)] - ZKx 1 , (206) 
is zero for some value u between 0 and u. From 

0 = —u'[F"(c + u') - F"(c - u')] - ZKu' 2 , (207) 

we find: 

2 F"{c + u') - F"(c - u') 

K =-~s - -... 27 . . 2 - (208) 

The 2 is inserted to make the fraction with denominator 2u' have the 
form of a difference quotient. By the law of the mean, this equals the 
derivative of F"(x) at some point Xo between c — u and c + u , and 
therefore between a and b. Thus 

K= -fF"'(* 0 ) - -!/"(*o), (209) 


E - Ku s - — -f"(x 0 )u 3 . (210) 

*5 

If we divide the interval of integration into n equal parts, each of 
width 

. b ■“ a /n, i \ 


by points x*, and denote the value of the integrand at x* by y*, 
Vk = /(**) ■* f(fl + kh), 

we may apply the preceding approximation to each part, with 


(213) 
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The sum of the approximations is: 

T = h + 2/i + 2/2 + • • • + Vn —i + • (214) 

This is known as the trapezoidal rule, since the graph of the function of 
equation (196) is a straight line, and the integral (197) corresponds to 
the area under this straight line, or that of a trapezoid. If the exact 
value of the integral is 

T + E, then E = - ~^nf 2 = - h- (215) 


Here, if the second derivative/"(x) is continuous in a, h, then/ 2 is the 
value at some point of the interval, since it is an average and therefore 
an intermediate value. Also, if f"(x) preserves its sign, the error has 
the sign opposite to this. In all cases, if M is the 
least upper bound of ]/"(x)| in the interval, f 2 is 
numerically at most M. Thus the error may be 
made small by taking n sufficiently large. 

A better approximate formula is obtained by 
using a second degree curve, whose graph is a 
parabola, 

g{x) = A + Bx + Cx 2 , (216) 



which has the same values as/(x) at a,b and the point halfway between, 

c = — . These determine the coefficients uniquely. For simplicity, 
2 

we write in place of equation (216), 

g(x) - A' + B'(x -c) + C'(x - c) 2 , (217) 


define u as in equation (202), and find that this makes g(c — u), g(c), 
and g(c + u) agree with /(a), /(c), and /(h) if: 


g(x) = /(c) + [/(h) - /(a)] ~ + [/(a) + /(h) - 2/(c)] ( * C) " 


2 u 


For the approximation to the integral (200) we have: 

C-ftl 


2u 2 


(218) 


flf(x),*fefc *= jT 


u , 


g(x) dx — — [/(a) +/(h) + 4/(c)] 


:[/(a) + 4/(c)+/(*>)]. 


6 


(219) 
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In this case the error E to be added is: 

E - F(b) - F(a) - ^ [f(a) + 4/(c) + /(b)], (220) 

or, in view of equation ( 202 ): 

E = F(c + u) - F(c - u) - | [F'(c + w) + 4F'(c) + F'{c - «)]. 

O 

( 221 ) 

We now assume that/(x) has a fourth derivative, so that F(x) has a 
fifth derivative throughout the interval. Define the constant K by 

K = ( 222 ) 

u 

and consider the function: 

G(x ) = F(c + x) - F{c - x) 

- \ [F'(c + x) + 4F'(c) + F'(c - x)] - Ax 5 . (223) 

O 

We find, successively: 

G'(x) - | [F'(c + x) + F'(c -x)- 2 F'(c)} 

- [F"(c + x) - F"(c - x)] - 5 Kx 4 , (224) 

O 

G"(x) = 5 [F"(c + x) - F"(c - x)] 

6 

- \ [F"\c + x) + F"'(c - x)] - 20Kx 3 , (225) 

O 

G"'(x) = - f [F IV (c + x) - F IV (c - x)] - 60Ax 2 . (226) 

O 

Each of these functions reduces to zero when x — 0 . But, from equa¬ 
tions ( 221 ) and ( 222 ), G(u) = 0 . Hence, by Rolled theorem G r (x) is 
zero for some value between 0 and u } say u f . It follows that G f/ (x) is 
zero for some value between 0 and u 7 , say u /f . Similarly G nr (x) is zero 
for some value u f ", and 
tn 

- — [F IV (c + u"') - F lx (c - u'")] - 60AV" 2 = 0 . (227) 

3 

We deduce from this that: 

i f iv ( c + 0-^-0 

in o-.'" 


K = - 


(228) 
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By the law of the mean, the fraction in the form of a difference quotient 
equals the derivative of F IV (x) at some point x a between c — v!" and 
c + « /// , and therefore between a and b. Thus 

K - ~ 55 F V (*o) - - ^/ IV (*o)« 6 . (229) 

if we divide the interval of integration into an even number of equal 
parts, say 2m, each of width 



(230) 


by points x/t, and define the y* by equation ( 212 ), we may apply the 
approximation to each consecutive pair of parts x 0) x 2 ; X 2 ,x 4 ; • • • ; 
X 2 m~ 2 t x 2 m* The sum of the approximations is: 

h 

S « g (yo + 4yi + 2 y 2 + 4 y% + 2 y 4 + • • • + 4 i/ 2 f?*-i + Stem)- (231) 


This is known as Simpson’s rule. If the exact value of the integral is 

S + E, then (232) 

Here, if the fourth derivative / IV (x) is continuous in a,b, then / 4 is the 
value at some point of the interval. Also, if / Iv (x) preserves its sign, 
the error has the sign opposite to this. In all cases, if M is the least 
upper bound of j / IV (a:) | in the interval, / 4 is numerically at most M. 

A comparison of equations (215) and (232) shows that, if the bounds 
for the second and fourth derivative are of the same order of magnitude, 
the error in using Simpson’s rule will be roughly A 2 /15 times the error in 
using the trapezoidal rule with n = 2 m, and hence much less when h is 
smaller than unity. 

Practically, it is not always easy to determine bounds for the deriva¬ 
tives. However, we may use the corresponding finite differences to 
estimate their size. This results from the discussion in section 93. If 
the nth difference changes slowly in the intervals under consideration, 
equation (300) of that section suggests that we may take 


A7(x) 

h n 


as an approximation to/ n) (x), 


(233) 


at least as to its order of magnitude. The estimated error when using 

j) — d 

Simpson ’8 rule will then be-—— A*, where A 4 is an average value 

loU 
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of the fourth difference computed for the increment h. The correspond¬ 
ing estimated error when using the trapezoidal rule is — a 2> with 

A 2 an average value of the second difference. 


EXERCISES VI 

1. If fix) = fi—x), fix) is called an even function. If fix) is even and 
integrable, show that £ fix) dx — j* f(x) dx = \ £ fix) dx, by using the 
fundamental definition of an integral. 

2. If fix) * — fi—x), f{x) is called an odd function. If fix) is odd and 

integrable, show that f fix) dx = - f* fix) dx, and that C fix) dx « 0. 

J-a Jq —a 

3. Prove that any single-valued function of an even function is even, and 
hence that for any continuous function F{u), the result of problem 1 applies to 
Fix 2 ) and F(cos x). 

4. Prove that the product of any number of even functions and an odd 
number of odd functions is odd, and hence that the result of problem 2 applies to 
xF{x 2 ) and xF(sin 2 x), where Fiu) is any continuous function. 

6. For the integrals over the intervals c — a,c; c,c + a; and c — a,c + a of 
a function such that/(c +■ x) = /(c — x) : state and prove a result analogous to 
that of problem 1. Similarly, for a function such that /(c — x) — —/(c + x) 
deduce a result analogous to that of problem 2. 

6. A function is said to be periodic of period p if fix + p) = fix). If such a 
function is integrable, show that 

r +p nv pa-bip pnp pp 

fix) dx — I fix) dx , and / fix) dx - I fix) dx = n I f(x) dx. 
v 0 J a Jo J 0 

7. Prove that any single-valued function of a periodic function is periodic. 
In particular show that if Fiu) is any continuous function, F(cos x) and F(sin x) 
may be used in the result of problem 6 with p = 2tt in all cases, and with p « *• 
if Fiu) is an even function. 

8. If f{x) is a continuous mono tonic function, prove that J* fix)dx is between 

(6 — a) fid) and (6 — a)/(6). In particular, show that for positive values of p 
dx 


and q, f 
Jo 


: lies between 2~~ q and 1 . 


0 ix* + 1 )< 

9. If fix) is a continuous monotonic function, prove that the integral 


particular, show that J~TZ 


fix 1 — 2 px + 5 ) dx is between 2af(q 
'* dx 


42 + 8 )' 


p 5 ) and 2 a/(a 2 + 3 — p s ). In 
lies between 2 • 4~ r and 2 • 5 -r . 
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10. For I x dx, verify that the sum S n of equation (76), section 128, is 

Jo 

n(n + 1 ) 0 a 2 

——a 2 , and hence —> ~ when n —» + oo. 

11. For & dz, verify that the sum S n is (e° — 1 ); 


and hence 


n(e° /n — 1 ) } 

approaches e° — 1 when n —» + co. 

r /»a 

sin x dx and / cos x dx. 

Jo 

Hint: If the sums are S n and C ro + uS n is the sum for J^ e%x <&> which equals 


ptaln 


^ n(e“'“ - 1) 

13. Using examples 1 and 2 of Exercises I, verify that for f x m dx, 

Qm +1 / n m-i 1 \ a m+l 

S n - ~TT7 (-— + a m n m + • • + Go ) and hence—>-— when n —> + oo. 

+ 1 / rn + 1 

14. Calculate the sum $ of equation (62), section 127, for points of sub¬ 
division Xk — r* for f xdx. Answer: , which —> - . when 

J i r + 1 2 

n—> + oo, where r n = a, so that r—»1. 

16. As in problem 14, calculate >S for xk = r* for f x m dx. Answer: 


f*(a m+l — I)(r — 1 ) 


a w+1 - 1 


(f*+ l -l) m -f 1 

x n+l _ 1 

16. Prove that lim -—— = log x. This proves that tim I x n dx = 

n—►—1 n 1 n-^-l t/1 

r~dx. 

Ji X 

17. Let a ,6 be divided into n equal parts by n — 1 intermediate points Xk = 
t (6 - a) 


a 4 


Prove that for any integrable function /(x), the limit of the 


average of the n values /(x*), as n —> + *> 


1 f 6 

)1S b — a J a ' 


f(x) dx. Illustrate for 


(b - a ) 2 

/(x) = (6 — x)(x a), for which the limit is---, 


18. Prove that lim n £ 
»- 

approximating | 7 
Jo 1 


^ „ — 7 ; « - • Hint: Identify with a sum 

»-*+*> n 2 + k 2 4 

dx 


+ r 


,2 * 
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19. Prove that 


lim — 2 

n^-H-oo n k**l 


Vn 2 — k z 



Hint: Identify with a sum 


approximating I Vi — x 2 dx. 

Jo 

20. Prove that the limits in problems 18 and 19 are the same if the sums be 
taken from & = p to h ~ n + q, instead of from k = 1 to k = n, where p and q 
are any fixed integral values. 


21. If A(x) and B(x) are polynomials, show that f 
A(b) 


A(x) 

Bix) 


dx contains a term 


^ 7 ^ log \x — b\ for each simple root b of B{x). These terms give the complete 

evaluation if B(x) is of higher degree than A(x) and has all its roots real and 
simple. Hint: Use section 116. 

/ * dx 

-7. Answer: A term 

x n — 1 

fn — 1 


~ log \x — 1 |, for n even a tenn — - log \x + 1 |. and in all cases I 
n n ' I 


other 


bk 2 irk 

terms of the form 2R — log (x — bk ), with bk = e xa *, a k =-, or more 

n n 


explicitly, 


cos ak 


, „ „ , „ 2 . , - cos at] 

log |1 — 2x cos ak + x l \ — ~ sin a k tan 1 --:-> • 


sin ak 


23. A curve whose equation is f(x,y) = 0 is said to be unicursal if the equation 
can be identically satisfied by putting x and y each equal to a rational function of 
a parameter t , and these functions give all points (x,y) of the curve. If, for the 
range considered, f(x,y) = 0 defines y in terms of x, and R(x,y) is a rational 


function of x and y } show 


that the integral J* 


X 

R{x,y) dx is rationalizable. 


24. If f{x,y) is a polynomial of the nth degree, and x 0 ,yo is a multiple point of 
the (n — l)st order, then /(x,y) = 0 is the equation of a unicursal curve as 
defined in problem 23. Hint: Any line y — yo » t(x — x 0 ) will cut the curve in 
at most one point distinct from xo,yo, so that if we eliminate y between the two 
equations, we shall have a first degree equation in x. Thus x and hence y may be 
expressed rationally in terms of t. 

25 . If P n (x t y) is a homogeneous polynomial of the nth degree, and P n -i(z,p) is 
a homogeneous polynomial of the (n — l)st degree, then P n (x,y) + Pn-i(z,y) — 0 
is the equation of a unicursal curve. The cubic x 3 + y z = xy is an example. 

t 

Hint: Use problem 24, with ( xo,yo ) = ( 0 , 0 ). For the cubic, y = tx f x = j > 


t 2 

y ~ i + < a ' 


26. The curve j{x,y) = 0 is unicursal if the equation obtained by eliminating y 
from f(x,y) - 0 and y - mx + t is of the first degree in x. This is analogous to 
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the situation of problem 24 with the multiple point “ at infinity in the direction 


of y » mx.” In fact, the projective transformation X «• -, Y =-takes 

X X 

f(x,y) «* 0 into F(X,Y) = 0 of the form described in problem 25, since 
y ** mx + t becomes Y « tX. 

27. Use the procedure of problem 26, with y =* x + t to rationalize 

< v A . . , ,, , , ... , . , ... dX 


y(x — y) 2 « x, and hence show that when this relation holds, I -— * 

*log|(z-y)’-l|. . J X ~ 3 V 

28. For a conic, n = 2 , and in place of the multiple point of order n — 1 of 
problem 24, we only need a simple point, so that any point will do. If y 2 = 
as* -f bx + c, and yl » ax* + 6 x 0 + c, show that y — 2/ 0 ~ t(x — x 0 ) leads to 

a substitution that will rationalizeJ* ft(x, Vox 2 + 6 x + c) dr. In particular, 

when c > 0, one possibility is x 0 « 0 , y 0 = and y = Vc + te. 

29. In problem 28, if a > 0 , show that we may apply the method of problem 26 
with m »= Vq] and use y = Vox + < to rationalize the integral of 
R(x, Vox 2 + 6x + c). 

SO. Show that if a curve is unicursal, its inverse curve under the transforma¬ 
tion of problem 15, Exercises V, is also unicursal. In particular, for the lemnis- 
cate (x 2 + y *) 2 = (x 2 — y 2 ) $ express x and y rationally in terms of t by applying 

1(4* \\ 

problem 29 to the inverse curve Y 2 - X 2 — 1, obtaining x —-— — ■— 

1 ( 1 * _ i) 

and y = —-- Hence show that when x and y are related by the equation 

< 4 + 1 

of the lemniscate, 

C x _ dx __ _ . x — y 

J y(x 2 + y 2 + i) 0g X 2 + y 2 

81. Prove that, if ^(x) can be integrated m+ 1 times in explicit terms, the 
integral of x m g{x) can be found by m + 1 integrations by parts. Hint: Write 
g{x) ** f "^(x), and use induction. 

32. If g(x) can be integrated m + 1 times in explicit terms, the integral of 
g(x) times any polynomial in x of degree at most m can be found by integrating 
by parts. Hint: Use problem 31. 

33. Assuming that J** g{x) dx « /(x), a known function, show that the 

integral of the inverse function g~ l {x) can be found explicitly. Hint: 

/ r*v rv 

g~ l (z) dx * / yg'(y) dy « / yf'(y) dy . Now use prob¬ 
lem 31. 

34. Let y m f~ l (x) be the inverse of a function f(y) which is a polynomial in 
any number of variables, each of which is y, c° v , sin by, or cos by ♦ Show that if 

P(x,y) is any polynomial, then fP(x,y) dx can be evaluated in terms of ele- 


Hence show that when x and y are related by the equation 


x — y 
x 2 + y 1 
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mentary functions. As particular cases we have y log x, y ~ sin *” 1 x, y » 
cos - * 1 x, y « sinh * -1 a:, and y = cosh "" 1 x. Hint; If x * fMyJ** !p[a? J jf t “ 1 (a?)] dx ** 

J* P[/(y),y]/'( 2 /) dy , an integral discussed in section 139. 

36. If 12 (cos x, sin x,y) is a rational function of the three variables, and 
= a + & cos x + c sin x, show that the integral of 22 is in general an elliptic 

integral. Hint: Put t — tan - as in section 138. 

2 

36. Show that if c = 0 and 6 = ± a, or if 6 = 0 and c = db a, the integral 
of problem 35 is rationalizable. 

37. Using an argument similar to that of section 142, show that the integral 
of 12 (x,y), any rational function, with y 2 = ax 2 + bx + c may be reduced to the 


calculation of integrals of the form 


/ * x dx (* x 

y 1 J 


dx 

y ’ 


and 


dx 


* f \x - r)y 


This 


procedure is often preferable to a direct rationalization of the original function, 
since these three forms may be treated as in the next four problems. 

38. If a y* 0 in problem 37, verify the reduction formula 


f 


x dx _ y + b 
y a 2a 


/ dx 

V 


/ x fa 2 /_ 

— = - V 6 x + c if a = 0, 
y o 




r*dx 1 . . 2ax + 6 

0 ; J — ~ — j* = sm 1 - j=== = if a < 0 ; and that 


4 ac 


V—a w 
J ~ log £ax + ~ + Va(ax 2 + bx + c) J if a > 0 . 


40. If y 1 
will reduce the integral J* 


problem 39. 

41. If y 2 * 
terms 


ax 2 + bx + c, and r is real, show that the substitution x » r- 

z 

« dx 

-- to an integral in z of the type evaluated in 

(x - r)y 

ax 2 + bx + c, a ^ 0 , and r is not real, the sum of the conjugate 


r 


(sx + t) dx 


dx 
(x - f)y 


. with all the constants 


may be written as f ,- 

(x 2 + p'x + q') V a(x 2 + px + q) 

real. Prove that the transformations used in section 141 to reduce the expression 
in equation (144) will reduce this integral to 

zdz . ^ C* dz 


r- 

J (A'. 


(A'** + B'WAz 1 + B 


of- 

J (A', 


(AV + B^VAz 1 + B 
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If + B * t % in the first integral, and A — t 2 in the second, the new 

r 


/ <dt 

-j 

Efi + F 


which may be evaluated as in section 137. 


42. Show that the integrand R(x, v cue 


cx + d) may be rationalized. 


Hint: Put ax + b = aA^t + and cx + d = cA ^ ^ if a and c have the 

same sign and if this makes A = i ( - — ~ j have the same sign as a and c. 

4 \a c) 


I have the same sign as a and c. 


Otherwise reverse the sign of A by interchanging a, b and c, d. If a and c 


have opposite signs, put ax + b = a A 




and cx + d = — cA 


choosing the notation so that A = - — - has the same sign as a and — c. 

a c 




43. Show that the integrand R 


ax + b cx + d^ 
' px + q * px + <7 > 


may be rationalized. 


Hint: Put y = -and then use problem 42. 

px + q 


44 . Show that J (ax + b) p x? dx, where p and q are rational, can be ration¬ 
alized if p, q or p + q is an integer. Hint: The first two cases reduce to one 
treated in section 138. When p + q is an integer, the integral is reduced to this 

case by putting t = a + ~ • 
x 

45 . If n is a positive integer, show that J* x n e* dx may be reduced by 

/ X ^ 

— dx. 

46 . If a n ~i = a(x) 0 in problem 8 of Exercises IV, show that W = Woe A{x \ 

when A(x) * I o(x) dx and Wq is the value of the Wronskian W at x 0 . This 

Jx* 

proves that if W 0 at one point x Q) it is always distinct from zero. 



CHAPTER VII 


INTEGRABLE FUNCTIONS 

In the last chapter it was proved that a sufficient condition for a 
function to be integrable is that it be continuous. We here derive 
several necessary and sufficient conditions for the integrability of a 
bounded function. 

These conditions enable us to show in particular that a bounded 
function continuous at all points of an interval with the exception of a 
finite, or enumerably infinite, number of points is integrable. We also 
show that monotonic functions are integrable and that a class of func¬ 
tions related to them, the functions of bounded variation, are integrable. 

146. Integrable Functions. In section 121 we defined a bounded 
function/(x) as integrable on the closed interval a, b, if 

s-i ms t (i) 

•=i 

approached a finite limit for any sequence of subdivisions of the interval 
a,b such that 5 m —* 0, and if this limit was the same for all sequences. 

We recall that the subdivisions were determined by points: 

a = x 0 < xi < x 2 < ■ ■ ■ < x„ = b, (2) 

that 

6, = x, — x,_i and that 5m = max (5,), (3) 

while the were any values such that 

x_, ^ x,. (4) 

147. Upper and Lower Integrals. Let the function/(x) be bounded 
on the closed interval a,b. Then, by section 31, it has a greatest lower 
bound m and a least upper bound M for this interval. Similarly, in 
each closed subinterval x,_i,x„ f(x) has a greatest lower bound m, and a 
least upper bound M„ with 

m g m,- ^ M, 3s M. (5) 

For any subdivision (2), we define the upper sum by 

S = £ Mi Si. 

i-i 


oon 


( 6 ) 



340 


INTEGRABLE FUNCTIONS 


[Chap. VH 


Since ail the {,• are positive, 

S = 2 X m &i ^ w»(6 — a). (7) 

%-i *-i 

Thus all the possible values of S are bounded from below, and so by 
section 10 these values have a greatest lower bound I. We call I the 
upper integral of the function /(x) for the interval a,b. We shall prove 
that for any sequence of subdivisions for which 

8m —* 0, we have S—*l or J' f(x) dx, (8) 

the last expression being an alternative notation for 1 in which the 
function and interval are indicated. 

We first consider a function for which m > 0, and hence M > 0. 
From the definition of / as a greatest lower bound, there is some sub¬ 
division whose upper sum S' is such that 

I ^ S' g / + €, (9) 

for any positive «. Suppose that the subdivision which has S' as its 
upper sum has N subintervals, and designate the points of subdivision 
by x'j and the length of the jth subinterval by 8'. 

Now consider any subdivision with 8m — V, and let its upper sum be 
S = JjM,Si. We separate this sum into two parts, Si, the sum over 
those intervals which do not include any point x' as an interior point, 
and $ 2 , the sum over those intervals which do include one or more points 
x'j as interior points. Since there are only JV — 1 interior points x'„ the 
sum <§2 contains less than N terms. For each of these terms Mi is at 
most M, and 5 ,- is at most tj. Hence we have: 

S 2 £ NMr,. (10) 

Each term of Si corresponds to an interval consisting entirely of 
points of some one closed subinterval Let the term of S' for 

this subinterval be M'fij. Now consider all those terms of Si,Mij8a 
where ij is a notation for those values of i such that 

x'j- 1 g Xi -1 < X, g x'j, (11) 

f<» any one j. Since the intervals x,j_i,x<y for a particular j are sub- 
intervals of the jth interval, and have no common interior points, we 
have: 

* 2* 8ij £ 8j and Mij M'j. 


(12) 
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But 5 a > 0, and M,j 2e m > 0, and hence: 

L Mijiij g M'jZ: 6ij g M'S y. (13) 

t i 

By summing this for all values of j, we find: 

Si ^ S'. (14) 

From the relations (10) and (14) we may deduce that: 

S = Si + S 2 £ S' + NMi). (15) 

Again, from the definition of I as a greatest lower bound, 

1 £ S. (16) 

From the relations (16), (15), and (9) we have: 

l^Sgl + e + NM V . (17) 

For any positive e, the subdivision with upper sum S' determines the 
number N. If we then take any subdivision with 

5m = v< '^m’ (18) 

we shall have: 

/ ^ S ^ / + 2e, or |S - /| S 2e. (19) 

The last two equations show that: 

lim S — I, (20) 

for any sequence of subdivisions for which 5m —* 0, as we set out to prove: 

If m 0, we replace fix) by fix) + k, where m + k > 0. Then 
S and 1 are replaced by S + fc(i> — a) and I + k(b — a). The result, 
lim S = I for fix), then follows from the corresponding result for 
fix) + k. 

We define the lower sum by: 

§ = £ ( 21 ) 

t-i 

By reasoning as before, it may be proved that all the possible values of 
§ have a least upper bound, /, and that, for any sequence of subdivisions 
for which 

5ivr —*• 0, we have §-*l orf fix)dx. (22) 

We call the last expression, or /, the lower integral of the function/(x) 
for the interval a,b. It follows from the relations (5), (6), and (21) that: 

S ^ S. (23) 



242 


INTEGRABLE FUNCTIONS 


[Chap. VII 


From this and the relations ( 20 ) and ( 22 ) we have: 

1 * L (24) 

This explains why we designated 1, a lower bound, as an up-per integral. 

It also follows from the definitions (I), ( 6 ), and ( 21 ) that 

S £ S ^ §. (25) 

If / = /, we may apply the last theorem of section 23 to this relation, 
in view of equations ( 20 ) and ( 22 ), and so conclude that, when 5jtf —» 0 , 
lim S = 1 = I. Thus the function is integrable, and the integral I is 
the common value of I and /. 

We may also prove a converse result. We first note that, for any sub¬ 
division determined by points ( 2 ), we may find points £, such that 

Mi - n < fib) £ M it (2G) 

by the definition of M, as a least upper bound, where 77 is any positive 
number. For such a choice of the points £,, we have 

S - nr, < S g S. (27) 

Next consider any sequence of subdivisions for which 8m —* 0. Let e 
be any positive number, and take v = e/n in the relation (27) for each 
subdivision. We thus determine a sequence of sums S which satisfy 

B - « < S g 8. (28) 

Now suppose that the function f(x) is integrable on the interval a,b. 
Then when 8m —* 0 , S—+ 1. But S —* /, so that it follows from the last 
relation that 

1 - e < I £ I, or / = /, (29) 

since t is arbitrary. Similarly we may show that 1 = 1. Hence, when 
f(x) is integrable, 1 = 1. 

We have thus proved the theorem of Darboux that: 

A necessary and sufficient condition that a bounded function be integrable 
on an interval is that, for this interval, its upper integral has the same value 
as its lower integral. 

In this case, the integral of the function equals the common value of 
the upper and lower integral. 

148. Outer Content. Let P be a set of points on the interval a,b. 
The function 4 >(x), which is equal to 1 if x is in P, and equal to 0 if x is not 
in P, is called the characteristic function of the set P. The upper integral 
erf 4>0) for the interval a,b is called the outer content of the set P. We 
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denote it by C, or € (P) when more than one point set is to be considered. 
Thus € is the greatest lower bound of all sums 

S - r M&, (30) 

formed for the function <}>(x), using some subdivision determined by 
points (2). But, for any closed subinterval x^i ,Zi the Mi for the 
function <t>{x) is 1 if this interval contains any points of P, and the Mi is 0 
if the subinterval does not contain any point of P. This shows that S is 
the sum of the lengths of those subintervals which include points of P 
as interior or end points. 

We shall now show that the outer content is determined by sums of 
lengths of intervals of a less restricted character. Consider any finite 
number of intervals, P. These intervals may contain points not on the 
closed interval a,6, may be open or closed, and may or may not overlap. 
By the length of the set of intervals P, we mean the sum of the lengths 
of the separate intervals belonging to P. We denote it by L. We shall 
say that any set of intervals P includes the point set P, if each point of 
P is an interior or end point of at least one interval of P. 

For any set of intervals P, which includes the point set P, we may form 
a subdivision of the closed interval a,b by the following process. Let 
dj be the end points of intervals of F. There is a finite number, N, of 
such points. Select any positive number c less than the minimum dis¬ 
tance between any two distinct a 3 , and put y — e/2N. Now use a, b and 
all the points <ij — y and ay + y which belong to the open interval a ,b 
as points xj of a subdivision. 

For this subdivision, and the function <fx(x) for the set P, we may form 
the upper sum, S of equation (30). We separate this sum into two 
parts. Let Si denote the part of the sum for those intervals which do 
not include any point ay, and S 2 denote the part of the sum for those 
intervals which do include at least one of the points ay. Since there are 
at most N intervals containing points ay, it follows from the choice of y 
and € that: 

S 2 ^ 2Ny g e. (31) 

Since every point of P is in some interval of P, and the intervals giving 
terms in Si include no end points of the original intervals of P, or points 
ay, every interval of the subdivision whose length appears in the sum 
Si multiplied by 1 is entirely contained in some interval P. Moreover, 
if several such intervals are contained in the same interval P, since they 
do not overlap or abut, the sum of their lengths is less than the sum of 
this interval P. This shows that: 

$1 3 ^ L. 


(32) 
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Consequently, we have: 

3 = Si H- S 2 S L Hh «, and L <£■ S — e. (33) 

The length L of any set of intervals F including the point set P is posi¬ 
tive. Hence the values of L admit zero as a lower bound and hence 
have a greatest lower bound L '. Since any sum S is the length of a set 
of subintervals which may be regarded as a set of intervals F including 
the point set P, and C is the greatest lower bound of the values of S, it 
follows that: 

L' g £. (34) 

But if we take a set of intervals F for which L < L' + «, and form the 
sum S which satisfies the relation (33), we shall have: 

V > L — e £ 5 — 2e £ V — 2e. (35) 

Since e is arbitrary, it follows from this relation that 

V £ C. (36) 

The relations (34) and (36) can only hold together if 

V - C. (37) 

This leads to an alternative definition of the outer content of the point 
set P, as the greatest lower bound of the lengths of all finite sets of intervals 
including the point set P. 

149. Zero Content. We have used the term outer content because, 
in treatments of integration more complete than that given here, an 
inner content is defined. The inner content is shown to be less than, or 
equal to, the outer content for all sets. The term content is reserved for 
those sets with the same outer and inner content. When the outer 
content is zero, the inner content is necessarily zero, and the set has con¬ 
tent zero. Thus we shall use the term zero content in place of outer 
content zero. 

Let /(*) and g{x) be two functions defined on the interval a,b. Let 
them both be bounded, so that for some M, 

|/(x)| < M and \g(x) | < M. (38) 

Suppose further that f(x) * g(x) for all values of x on the interval a,b 
which do not correspond to a point of a certain point set P. Then if 
*(x) is the characteristic function of the set P, and we denote the func¬ 
tion for which a sum is formed by a subscript, we shall have: 

13/ - 2MS+ and \§ f - &| £ 2MS 4 . 


( 39 ) 
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If both functions are integrable, we have from either equation 

I If - Ig\ £ 2 MC(P), (40) 

by considering a sequence of subdivisions for which 6m —» 0 . 

If the set P is of zero content, we may conclude from the equation (39) 
that 

If = l g and If = l a . (41) 

This shows that, if one function is integrable, the other is also, and the 
integrals are the same. 

This leads us to extend the definition of integration to functions 
defined at all points of an interval a ,b except a set of zero content. If 
such a function has an integral when we use zero as the value of the 
function at the points where it is not defined, we say that the function is 
integrable over the interval a, b. By the result just proved, the function 
will have the same integral if we use any set of values having an upper 
bound in place of zero for the set of zero content. 

160. Oscillation of a Function at a Point. The oscillation of a 
bounded function in an interval was defined in section 31 as M — m, 
the excess of the least upper bound over the greatest lower bound for the 
interval. 

Consider now a bounded function /(x) for values near x 0 . Let 

lim /(*) = / and lim f(x) = /. (42) 

X—♦To X—►Xfl 

Then, for any positive €, in any interval including the point Xo as an 
interior point and of sufficiently small length, h < 6 () for all values of 
x 5 ^ Xo we shall have: 

/(x)</+€, /(x)>/-€. (43) 

Also, for any positive r?, for some value x f in the interval of length h , 

f{x') > } - v, fix') <f+n- (44) 

Now let Mo be the larger of /(io) and/, and mo the smaller of/(x 0 ) and 
/. Then the oscillation for the small interval including x 0 cannot 
exceed 

Mo — mo + 2«, (45) 

and is at least as great as 

M 0 — m 0 - 2n or M 0 — mo, (46) 

since n is still arbitrary after t has been fixed. Thus, for any sequence of 
intervals, including Xo as an interior point, whose lengths approach zero, 



246 INTEGRABLE FUNCTIONS [Chap. VII 

the oscillation approaches Af 0 — m 0 . This is called the oscillation of 
the function at the point x 0 . 

Since any interval including the point x 0 as an interior point includes a 
point x r for which the relation (44) holds, for this interval we have: 

M > Mq — 7 ?, m < m 0 + rj, (47) 

and 

M — m > M 0 — m 0 — 2rj or M — m g M 0 — m 0 , (48) 

since n is arbitrary. This leads to an alternative definition of the oscilla¬ 
tion of a function at a point, as the greatest lower bound of the values of 
the oscillation of the function for all intervals including the point as an 
interior point. 

If the function is continuous,/ = / = /(x 0 ), so that Mo = mo, and the 
oscillation is zero at the point. Conversely, if Mo = m 0 , it follows from 
M 0 ^ f(x 0 ) § mo that f(x 0 ) = M 0 = mo = / => /, and the function is 
continuous. Thus: 

A necessary and sufficient condition that a function be continuous at a 
point is that the oscillation at the point be zero. 

In applying the definition of oscillation to the left end point a of a 
closed interval, we use right-hand upper and lower limits, or intervals 
having a as a left-hand end point. Similarly for the right end point b. 
The theorem then applies to such points, in view of our conventions as to 
continuity at the end points of a closed interval. 

161. A Condition in Terms of Content. We shall now prove the 
theorem of Jordan: 

For a bounded function to be integrable on an interval it is necessary 
and sufficient that the outer content of every point set P e be zero , where P t 
is the set of points on the interval at which the oscillation of the function is 
greater than or equal to c, any positive number. 

We first prove the condition sufficient. We select a positive c. Since 
the outer content of the point set P t is zero, the point set P £ may be 
included in a finite set of intervals F, such that the length of the set F f 
or sum of the lengths of the separate intervals L, is less than c. If the 
set F contains N closed intervals ay,by, we replace each such interval by 
the open interval ay — c/2 N, by + c/2 N. In this way we obtain a set of 
open intervals F\ such that the length of the intervals F r or V is less 
than 2c, and the set of intervals F f covers the set P t in the sense of 
section fly 

We jtehkt consider the set of points Q, those points of the closed inter¬ 
val a^lrhich do not belong to P € . Since the oscillation of the function 
at any point z 0 of the set Q is less than c, we may include Xo in an open 
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interval Go such that the oscillation of the function in this interval is less 
than 2c. Let G be the infinite set of all such intervals Gq . Then, since 
G covers Q, and F' covers P, the set of intervals G together with the 
intervals of F f cover all the points of the closed interval a, b in the sense 
of section 11 . Therefore, by the Heine-Borel theorem, we may select 
from these a finite number of intervals G f which cover all points of the 
closed interval a, b. Let the end points of the intervals G f be a'. There 
is a finite number N' of such points. Let 7 ? be a positive number such 
that 2 N'-q is less than e. We now take a,b and the points aj — tj and 
a' + 7) which belong to the open interval a,b as the points x x of ( 2 ) used 
to form a subdivision. We distinguish three types of subintervals. Let 
H\ be those subintervals which include at least one point a' as an 
interior or end point. For any one a' the single interval including it, 
or the two abutting intervals having it as an end point, must form all or 
part of the interval a' — 77 ,a' + 17 , whose length is 2tj. Hence the total 
length of subintervals H x is at most which is less than c. 

Any subinterval not II\ may be included in a single interval G\ since 
it contains no end points of intervals (?', or points a 3 . We denote by H 2 
those subintervals not H x which may be included in intervals of G 9 
which are also intervals of F\ Since the subintervals do not overlap, 
the total length of the subintervals II 2 can not exceed the total length of 
intervals F f , or V which is less than 2 e. Finally we denote by H 3 those 
subintervals not II x which are not H 2 . These may be included in inter- 
vals of G' which are not intervals of F\ and hence must be intervals G 0 , 
in which the oscillation of the function does not exceed 2 c. 

Let us now form upper and lower sums for our subdivision, 

S = EJIJA, S = 1X5, (49) 

We have, accordingly, 

S - S = Z(AL - m,)«.. (50) 

For the intervals II 3 , the oscillation M t — m l < 2 c, and as the total 
length of these intervals is less than 6 — a, we have 

2c (6 - a) (51) 

as an upper bound for the contribution to the sum (50) from the intervals 
Ha. For the intervals H x and H 2 , the oscillation is at most M — m, 
and as already observed, the total length of the intervals H x and H 2 
together is at most c + 2 e or 3c. Thus we have: 


3c(ilf — m) 


(52) 
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as an upper bound for the contribution to the sum (50) from the intervals 
H\ and H%. This shows that: 

S — $ <C 2 e(b — o) -f- 3 e(M — ni). (83) 

This inequality will still hold if, instead of the subdivision just used, 
we use any subdivision obtained from it by introducing new points 
Xi and retaining all the old ones. We may do this in such a way that 
8m 0, and so deduce that: 

I - J £ 2*(6 - a) + 3 t(M - m). (54) 

Since «is arbitrary, it follows from this relation that 1 — 1 = 0, and the 
function is integrable by the theorem of Darboux in section 147. This 
proves the condition sufficient. 

To prove the condition necessary, let D, denote the outer content of 
the point set P t . Now consider the sums S and S for any subdivision. 
From the definition of oscillation at a point as a lower bound, for any 
subinterval G including a point of P e as an interior point the oscillation 
for the interval is at least e, and M,- — S; e. But, the only points P, 
not included as such interior points are those which are end points of 
subintervals. As there are only a finite number of subintervals, say N, 
we may include them all in a finite set of intervals G' of total length ij, 
by taking each end point of a subinterval in an interval G ' 0 of length 
i)/2JV. If the total length of the intervals G is L, the intervals G together 
with G' have a total length L + v at most. But they include all the 
points Pf Hence, from the definition of C t as a lower bound, we have: 

L + n £ C t , or L ^ C, (55) 

since rj is arbitrary for any particular subdivision and fixed e. The con¬ 
tribution from any interval to the sum: 

S - 8 = L (Mi - mi)8 u (56) 

is positive or zero. But the contribution of the intervals <?, which 
have a total length L ^ (?« and for which — m, > e, is at least 

«£., (57) 

so that: S — § gt tC. (58) 

Since this is true for all subdivisions, it follows that: 

1 ~ I > eC„ (59) 

for every positive number «. Since C, is necessarily positive or zero, 
if it were not zero for all values of e, we should have 1 — J > 0, and the 
function would not be integrable. This proves the condition necessary, 
and completes the proof of the theorem. 
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162. Exterior Measure. The condition of integrability is simpler 
when stated in terms of exterior measure, which we shall now define. In 
the definition of outer content as a lower bound, finite sums of intervals 
were used, and the sum of their lengths was called the length of the set. 
For exterior measure, use is made of infinite sequences of sets of intervals, 
each set of which includes all the intervals in the preceding set and some 
additional intervals. Each set H n contains a finite number, N, of inter¬ 
vals. However, the number N will increase indefinitely as n increases. 
If L n is the length of H n , then L N increases with n, so that either 

lim L n = L, or lim L N — + 00 . (60) 

We may form an enumerably infinite set of intervals /*, by starting 
with the intervals in H\ arranged in some order, then using the intervals 
in # 2 , but not in Hi, in some order, and so on. If we denote the length 
of the first k intervals by L*, this will be consistent with the definition of 
L n , since the first N intervals make up H N . Since, for any k, we may find 
two numbers N and N r such that N g k g N\ it follows that: 

L N ^ Lk S L n>) and lim L* = lim L N . (61) 

Thus the sequence of sets of intervals with //', made up of the first n 
intervals /*, is made up of the same intervals as the original sequence of 
sets H n , and has the same length. It has the further property that each 
set includes just one more interval than the preceding set. We refer to 
the sequence of sets of intervals Il' n as the set of intervals /*, and call L 
the length of the set of intervals. 

For any set of points P on a finite interval a, b there are finite or 
enumerably infinite sets of intervals /&, which include the points of P in 
the sense that every point of the set P is a point of at least one of the 
intervals I*. Some of these sets of intervals have finite length L, since 
the single interval of length b — a is one such set. Since these finite 
lengths L are all positive or zero, they have a greatest low T er bound, which 
we call the exterior measure of the set of points P. That is: 

The exterior measure of a set of points P on a finite interval is the 
greatest lower bound of the lengths of all possibU finite or enumerably infinite 
sets of intervals which include all the points of P. 

This only differs from our second definition of outer content in includ¬ 
ing the possibility of an enumerably infinite set of intervals. Since we 
are retaining the possibility of using the finite sets considered in deter¬ 
mining outer content, it follows that the greatest lower bound from the 
new definition will be less than or equal to that found before. Thus, if 
we use MqtM (P) to denote the exterior measure, we have 

M&C. 


(62) 
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153. Zero Measure. For reasons similar to those mentioned in 
section 149, we refer to a set of exterior measure zero as a set of measure 
zero. As a preparation for the proof that certain combinations of sets 
of measure zero are again sets of measure zero, we discuss a property of 
enumerable sets. 

In section 2 we defined a class of objects as enumerable if it could be 
arranged in a single discrete sequence. Thus a finite set of intervals, or 
an enumerably infinite set of intervals /*, is an enumerable set of inter¬ 
vals. Now consider an enumerable number of enumerable sets of 
intervals, Iij . For each j, i = 1, 2, 3, • • • gives an enumerable set of 
intervals. The enumerable set of sets is obtained by taking j = 1 , 2 , 3, 
• • • . For each positive integer k , the intervals 7 t; , with i + j = fc, form 
a finite set of intervals F*. If we arrange these in order of increasing k, 
and then arrange the intervals of each set F* in order of increasing i, all 
the intervals Iij will be enumerated: 

1 11J 1 12) I 2 U I 13, I22i 1 315 1 14, 1 23) 1 32) ^41? * * * • (63) 

This shows that an enumerable number of enumerable sets of intervale 
may be enumerated. Compare Exercises I, problems 12 and 13. If for a 
particular j, the set of intervals 7 i; is finite and has Nj intervals, we omit 
from the sequence (63) all 7 i; for this j with i greater than Nj. Again, 
if the number of sets is finite, say N', we omit all intervals 7 i; with j 
greater than N The sequence of intervals (63) will be* enumerably 
infinite unless we have a finite number of finite sets. 

Next consider an enumerable number of sets of points, P y Let each 
set Pj be of measure zero. We may form a composite set P } consisting 
of all points which are in at least one of the sets Pj. We shall now prove 
that the set P is also of measure zero. 

Since the set of points Pj is of measure zero, it may be included in an 
enumerable set of intervals whose total length Lj is less than t/2 3 , where 
c is any fixed positive number. Call the intervals of this enumerable set 
Iij , Then the totality of intervals 7 t > may be enumerated as in (63). 
We may use this sequence of intervals to form a sequence of sets of inter¬ 
vals H nt by taking In as Hi, In together with the parts of I \2 not in In 
as H%, and so on. Then for any n, H n consists of parts of a finite num¬ 
ber of intervals Iij. If N is the largest value of j for any of these, the 
sum of the lengths of all these intervals 7 t; used in forming H n will not 
exceed: 

Lt + 1*2 + * * * + Ln * g + 2 s + ’ *' 2 ^ ~ ~ ^ c * (®*) 

Thus the length of any set H n will not exceed e, and hence the length of 
the enumerable sequence of sets H n will not exceed e. But there is an 
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enumerable sequence of intervals with the same length as the sequence 
of sets H nj and which includes each point in any of the H n . Thus it 
includes each point in any of the intervals / t y, and hence each point in 
any of the sets Py. This shows that the composite set P may be included 
in an enumerable set of intervals of total length at most e. But e is 
arbitrary, so that the measure of the set P is zero. 

We have thus proved that: 

The set consisting of all points in at least one of an enumerable number of 
sets of points , each of which is of measure zero , is again of measure zero . 

Since a single point may be included in an interval of arbitrarily small 
length, it is of measure zero. Hence a set consisting of an enumerable 
number of distinct points is of measure zero. In particular, any set 
containing only a finite number of points is of measure zero. 

Again, consider a set made up of those points of the closed interval 0,1 
whose coordinates x are rational numbers. These form a set of measure 
zero, since they may be enumerated by the method used in section 2 . 
This set illustrates the possibility of inequality in the relation (62). For, 
if we divide the unit interval into subintervals in any way, every sub¬ 
interval will contain rational points, so that the outer content of this set 
is unity. Thus for this set M = 0, but C = 1 . 

164. Closed Sets. A closed set of points was defined in section 12 
as one which contained all its limit points. We shall now prove that, 
whenever the set of points P is closed, the exterior measure of the set P 
is the same as the outer content, so that we have, in place of the relation 
( 62 ), 

M = € for closed sets. (65) 

We first observe that, from the definition of M as a greatest lower 
bound, there is some enumerable set of intervals including all the points 
of P whose total length L satisfies: 

M S L < M + e, ( 66 ) 

for any positive e, Let us fix e, and determine an enumerated, non¬ 
overlapping set of intervals G of t his character. Some of the points of P 
may be end points of intervals G. If we replace the nth interval of G, 
with end points a', 6 ', by the open interval a' — e/ 2 n , 6 ' + e/ 2 n , we 
obtain a new set of intervals G f such that every point of P is an interior 
point of an interval G' f and the intervals G r cover the set P in the sense 
of section 11. It follows, from the modified Heine-Borel theorem of 
section 12, that we may find a finite subset P' of intervals G' which 
covers the set P. Thus the points of P are included in the finite set of 
intervals F\ 
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Let us denote by F the finite set of intervals G associated with those 
intervals of G' which are in F', and let E denote the finite set of intervals 
added to the ends of the intervals F to form the intervals F\ Each 
interval of F, as an interval G, may be associated with a positive integer 
which gives its place in the enumerated sequence. As there are only a 
finite number of such integers, there is a largest one, say N. If L„ is the 
total length of the first n intervals G, we have 

L„ g Ln+ 1 and lim L n = L, (67) 

so that: 

Eu ^ L. ( 68 ) 

Also, if L’ n is the total length of the intervals added to the first n intervals 
G to form the corresponding intervals G', we have by reasoning, as in 
equation (64): 

L'„ < 2t for all n. (69) 

Since the intervals of the set F' are all among the first N intervals G', 
we have for the total length of the intervals F', or L(F'): 

L(F') £ L n + L' n g L + 2(. (70) 

But, from the definition of C as a lower bound of finite sets of intervals 
which include all the points of P, we have: 

C £ L(F'), (71) 

and hence from the relations (70) and (66), 

C g L + 2e g M + 3«, or C £ M, (72) 

since e is arbitrary. This, combined with the relation (62) shows that 
C — M for any closed set P, the relation (65) which we set out to prove. 

166. Closure. If we take any point set P, and designate by P 1 the 
set consisting of all the limit points of P, then the set consisting of all the 
points which are in either P or P', or in both, is called the closure of the 
setP. We denote it by P + P', and shall prove that it is always closed. 
For, if Q is any limit point of this set, any open interval which has Q 
as an interior point will either contain points of P, or points of P'. But 
any open interval which contains a point of P' contains a limit point 
of the set P and hence points of P. Thus any point Q is necessarily 
a limit point of the set P, and therefore a point of the set P'. Hence the 
set P -J- P r contains all its limit points, Q, and is a closed set. 

Colder next any finite set of closed intervals F which includes all the 
pointer of P. We shall show that F must include all the points of P'. 
FoiiM x' is any point of P', we may select a sequence of distinct points 
of the set P, such that lim z* = x', as n —► + ». Since there are 
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only a finite number of intervals in the set F, some one must contain an 
infinite number of points x„, and hence the point x', since the interval is 
closed. This proves that F includes all the points of P'. Since F 
includes all the points of P, it includes all the points of P + P'. 

Let us now consider C(P), the outer content of P, and also 
C(P + P'), the outer content of the closure of P. Since the set P + P / 
includes all the points of P, any finite set of intervals which includes 
P + P' includes P. Therefore: 

C(P) ^ £(P + p'). (73) 

But, for any positive e, we may find a finite set of intervals, F' which 
includes P and with total length L, such that: 

C(P) C(P) + £ . (74) 

By adding the end points of these intervals to them, we obtain a finite 
set of closed intervals F with the same total length L. Since the set of 
closed intervals F includes the set P, it includes the set P + P', and: 

C(P + P') ^ L. (75) 

Hence, from the relation (74), 

C(P + P') g C(P) + e, or C(P + P') g C(P), (76) 

since e is arbitrary. A comparison of the relations (76) and (73) shows 
that: 

C(P + P') = €(P), (77) 

and the outer content of any set is the same as the outer content of its closure. 

The set of rational points on the interval 0,1 provides an illustration 
of this theorem. Since every point of the closed interval 0,1 is a limit 
point of rational points, for this set P the set P' contains all the points 
of the unit interval. Thus the closure of this set, P + P', consists of 
the points of the unit interval, and C(P + P') = 1, in agreement with 
equation (77) and the fact that C{P) = 1, which we proved as the end 
of section 153. 

166. A Condition in Terms of Measure. Given any function f(x), 
bounded on the closed interval a,b, and any positive «, let us consider 
P«, defined in section 151 as the set of those points on the interval a,b 
at which the oscillation of the function/(x) is greater than or equal to «. 
We recall that the oscillation at a point x 0 is the greatest lower bound of 
the oscillations for all intervals which include the point x 0 as an interior 
point. If Xo is a limit point of points belonging to P„ every interval 
including *q as an interior point will include a point of P „ and therefore 
the oscillation of /(x) for this interval will be at least«. It follows that 
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the oscillation of f(x) at the point £ 0 will be at least «, and x 0 is a point 
belonging to P ,. This proves that the set of points P, is closed. 

Now let D denote the set of points of the closed interval a,b at which 
/(x) is not continuous. We shall prove that if the exterior measure of 
the set D is zero, the function /(x) is integrable on a,b. We showed in 
section 150 that if the oscillation of /(x) at a point is zero, /(x) is con¬ 
tinuous at the point, and conversely. Thus at any point D, the oscilla¬ 
tion of /(x) is positive. Conversely, any point at which the oscillation is 
positive is a point of discontinuity, and all the points of any set P t are 
included in the set D. Thus any enumerable set of intervals which 
includes the set D, also includes the set P, and: 

M(P ( ) g M(D). (78) 

But, since the set P, is closed, by equation (65), we have: 

€(P t ) « M(P t ). (79) 

If now the exterior measure of D is zero, it follows from the last two 
relations that the outer content of P e is zero. As this is true for all e, 
the function f(x) is integrable on the interval a,b by the theorem of sec¬ 
tion 151. 

We may show conversely that if the function f(x) is integrable, the 
set D has its exterior measure zero. To do this, we take e = 1/n, where 
n is any positive integer, and consider the set P € . Since f(x) is inte¬ 
grable, the set P< has its outer content zero. Hence by equation (79), 
its exterior measure is zero. 

For n= 1, 2, 3, • • * , the sets P with e = 1/n form an enumerable 
number of sets of measure zero, to which we may apply the theorem of 
section 153 to deduce that the set consisting of all points in at least one of 
these sets is of measure zero. But this set is the set D. For we have 
already seen that every point in any P t is a point of D, and at any point 
of D the oscillation of /(x),p, is positive. Since any positive number p 
exceeds 1/n when n exceeds 1/p, it follows that every point of D is in all 
the sets P t with sufficiently smallor sufficiently large n. 

Thus D is of measure zero when f(x) is integrable, as we set out to 
prove. This completes the proof of the theorem of Lebesgue: 

For a bounded function to be integrable on an interval , it is necessary and 
sufficient that the function be continuous at all points of the interval , with the 
exception of a set of points whose exterior measure is zero . 

Let g(x) be a function of x determined by an enumerable number of 
functions fi(x), i = 1, 2,* • •, in such a way that g(x) is continuous 
whenever all of the/** (x) are continuous. Then if g(x) is bounded, and 
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all th efi(x) are bounded and integrable on the interval a,5, the function 
g(x) is integrable on that interval. 

For the points where any one of the functions fc(x) is discontinuous 
constitute a set A of measure zero. By section 153, the set consisting 
of all points in at least one of these sets is again of measure zero. But 
g(x) must be continuous except at points belonging to one of the sets A, 
and hence to this set. Thus, since it is bounded and continuous with 
the exception of a set of points of measure zero, it is integrable. 

In particular, the result applies to a finite number of functions fi{x), 
and shows that a continuous function of a finite number of integrable 
functions is integrable if it is bounded. 

167. A Special Class of Integrable Functions. A set containing no 
points is considered to be contained in any interval, and hence to be of 
exterior measure zero. Thus the theorem of section 122 on the integra- 
bility of continuous functions is included in the result just proved. 

Again, it was shown in section 153 that a set consisting of an enumerable 
number of distinct points is of measure zero. Hence we have as an 
important special case of the theorem of the last section: 

A bounded function , continuous on an interval , or continuous at all 
points except a finite number , or an enumerably infinite number of points , 
is integrable on the interval . 

158. Monotonic Functions. Suppose the function/(x) is defined and 
monotonically increasing throughout the closed interval a,b in the sense 
of section 27. Then, 

if a g Xi < x 2 g b, f(xi) £ f&z)' (80) 

In particular we have: 

/(a) 3S f(x) fib), (81) 

for all points x of the closed interval, so that the function is bounded. 
From this, and the theorem of section 27, it follows that as we approach 
#o, any point of the interval, from the left, a limit is approached, which 
we denote by /(x 0 —): 

/(*o-) = lim /Or). (82) 

X —►Xq — 

Similarly, we use fix 0 +) to mean the limit from the right: 

Six 0 +) = lim fix). (83) 

For the oscillation of fix) in any closed interval x 0 — h,x 0 + h, we 
have 

/(*o + h)~ fixo - h), (84) 
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as a consequence of equation (80). Hence, for the oscillation of fix) 
at *o> as defined in section 150, we have: 

/(*o+) -/(*«-). (85) 

Now suppose that there are N interior points x, of the interval a,b at 
which the oscillation of f (x) is at least t. From the relations 

/(a) £ fix, - ); /(*,+) g f(x i+ 1 -); /(**+)£ fQ>), (86) 

it follows that: 

f(b) - fia ) Ne, and N g ^ . (87) 

This shows that for any given e, there are at most a finite number of 
points in the sets P t . By starting with the points at which the oscilla¬ 
tion is 2:1, followed by those at which the oscillation is <1 and ^ 1/2, 
and so on, we may enumerate all the points at which the oscillation is 
not zero. The points added at the nth stage are finite in number, since 
they are included in P t , with e = 1/n. Since the function is continuous 
at all points at which the oscillation is zero, this proves that: 

A function, monolonic on a closed interval, is either continuous on the 
interval or continuous at aU points except a finite or an enumerably infinite 
number of points. 

While we have stated the argument for monotonically increasing func¬ 
tions, we may either use a similar argument for monotonically decreasing 
functions, or replace fix) by —fix). 

This result, combined with that of section 157, proves that: 

A bounded function is integrable on any interval on which it is monotonic. 

Or, since a monotonic function on a closed interval is necessarily 
bounded: 

A function monotonic on a closed interval is integrable on that interval. 

189. Functions of Bounded Variation. The sum of a monotonically 
increasing function and a monotonically decreasing function will be 
continuous unless one of the monotonic functions is discontinuous. 
Thus any such sum will have at most an enumerable number of dis¬ 
continuities, and so be integrable on any closed interval. 

We may characterize such functions in terms of the notion of variation 
of a function, which we proceed to define. For a function fix) defined 
on a closed interval a,b we may form the sum 

» - £ I/(*») ~ 


(88) 
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for any points (2) of a subdivision of the interval a,6. If the values of v 
for all possible subdivisions are bounded, the function/^) is said to be of 
bounded variation on the interval. In this case, v has a least upper 
bound, V , which we call the total variation of the function on the interval. 
Let p denote the sum of those differences /(#») — /(xj_i) which are posi¬ 
tive, and let — q denote the sum of those which are negative. Then: 

= P + ®» (89) 

and 

V - 9 - - fix;-!)} = /(*,) - /(xo) = /(6) - /(a). (90) 

It follows that: 

2p = v + f(b ) - /(a) and 2g = v + f(a) - /(&). (91) 

Thus, if the sums v have an upper bound, the sums p and q also have an 
upper bound. We denote their least upper bounds by P and Q. From 
the equations (91) we see that a subdivision which makes any one of 
these numbers approximate its least upper bound does the same for the 
other two, and 

2P - V + m - f(a), 2Q « F + /(a) - /(b). (92) 

Now let v(x) be a number corresponding to v when we take the interval 
a,x in place of a,f>. We may use the value x as one of the points of the 
subdivision used to calculate a value of v. Also all the terms in the sum 
for v in equation (88) are positive. Thus any subdivision of the interval 
a,x giving a value v(x) may be used with any subdivision of the interval 
x y b to give a value of v which is equal to, or greater than, v(x). This 
shows that if v is bounded, all the sums v(x) are bounded, and the func¬ 
tion is of bounded variation on any interval a y x. If V (x) is the least 
upper bound for the values of v(x ), for a given x, we have: 

V(x) S V . (93) 

Also, by using the reasoning with any x f > x in place of 6, we see that 
V(x) § T(x') if x < x\ (94) 

Thus the function F(x) is a monotonieally increasing function of x. 

Now denote the numbers corresponding to P and Q for the interval 
a,x by P(x) and Q(x). Then, as in equation (92), we have: 

2P(x) = V(x) +f(x) - /(a) and 2 Q(x) = V(x) +f(a) - f(x). 

(96) 

The argument used to establish the relation (94) may be applied to the 
positive sums for p(x) and q(x), the analogues of p and q for a,x, to show 
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that P(x ) and Q(x) are each monotonically increasing functions of x. 
Finally, from equation (96) we have 

/(*) - [/(<*) + Pm - Q(x), (96) 

which shows that every function of bounded variation may be regarded as 
the sum of a monotonically increasing function and a monotonically de¬ 
creasing function. 

From this and the remark made at the beginning of this section, it 
follows that: 

Every function of bounded variation on a closed interval is integrable on 
this interval . 

Let us next show that on a closed interval every sum of two mono¬ 
tonic functions is of bounded variation. We first note that if f{x) is 
monotonically increasing, all the differences/(x*) — /(x 2 _i) are positive 
or zero, so that q = 0. Hence by equation (90), p = f(b) — /(a) and: 

Q = 0, y=y = P = p= f(b) - /(a). (97) 

Thus on a closed interval a monotonically increasing function is of 
bounded variation. Similarly, on a closed interval a monotonically 
decreasing function is of bounded variation. 

But if we write 

bFi = F{Xi) - F(x,(98) 
and interpret bG{ and bHi similarly, where 

H(x) = F(x) + G(x) y (99) 

we have the relations: 

bHi - SFi + bGi and \bHi\ g \bFi\ + |«G<|. (100) 

By considering these last relations for i == 1 to n and summing, we find 
that for any subdivision the sum v for H (x) cannot exceed that for F(x) 
plus that for G(x). This shows that the sum of two functions of bounded 
variation is again of bounded variation. 

In particular, on a closed interval any sum of a monotonically in¬ 
creasing function and a monotonically decreasing function is of bounded 
variation, and the class of such functions is identical with the class 
of functions of bounded variation, in view of the result deduced from 
equation (96). 

We may replace the monotonic functions of the decomposition by 
increasing and decreasing functions. For example, we may write 

/(*) - L f{a) + P(x) + x + k]- [Q(x) +x + k] (101) 
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in place of equation (96). We may thus consider a function of bounded 
variation as equivalent to the difference of two increasing functions, each 
positive if k > —/(a) — a and k > —a, since P(a) = Q(a) = 0. The 
functions of bounded variation are the most restricted class of functions 
on a closed interval including all positive increasing functions, and func¬ 
tions which are linear combinations of a finite number of such functions. 

160. Operations on Functions of Bounded Variation. We have 
already remarked that the sum of two functions of bounded variation is 
of bounded variation. This result persists if we replace the funda¬ 
mental operation of addition by subtraction or multiplication. For, if 
y and y' are two functions of bounded variation, we may write: 

y ~ s ~ t and y' - s' — t', (102) 

where s, t, s', and t' are all monotonically increasing functions. Conse¬ 
quently we have 

y - y' = (s + t') — (t + s'), (103) 

which shows that the difference of the two functions is the difference 
between two monotonically increasing functions, and hence is of bounded 
variation. Similarly we may deduce from 

yy' = (ss' + tt') — (st' + ts') (104) 

that the product of the two functions is of bounded variation. 

Since y'/y = (1 /y)y', the quotient of y' by y will be of bounded varia¬ 
tion if y and the reciprocal of y is of bounded variation. We shall show 
that 1/y is of bounded variation on any interval on which y is of bounded 
variation and uniformly bounded away from zero. That is, if y = f(x), 
there is some fixed positive number m such that 

1 / 0*01 ^ (195) 


for all x on the interval considered. 

If we put 

f(xi) = A and /(&*_i) = B, 

we have: 

1 _ I = <~\a~ b\. 

A B AB m 2 


Hence, with the notation of equation (98), 


■©, i*± 


£ Wi\, 


(106) 

(107) 

( 108 ) 
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and the variation of the reciprocal of f (x) admits 1/m 2 times the variation 
of/(x) as an upper bound. This proves that with the restrictions stated, 
1/y is of bounded variation. 

We have thus proved that the quotient of two functions of bounded 
variation is of bounded variation, provided that the function in the 
denominator is uniformly bounded away from zero. 

161. Continuous Functions of Bounded Variation. We may show 
that the variation function 7(x), as well as the functions P(x) and 
Q(x), are continuous functions of x at any value x 0 where f(x) is con¬ 
tinuous. In view of the relations between the three functions given in 
equation (95), it is sufficient to prove the property for 7(x). 

Let/(x) be continuous at x 0 . Then, for any positive e, 

!/(*') ~f(Xi o)| < €, if |x' - x 0 | < 6,. (109) 

From the definition of 7 as an upper bound, there is a subdivision of a,b 
which makes 

v > 7 — e. (110) 

Since the sum v may increase but cannot decrease, if we use additional 
points of subdivision and retain all those already present, we may 
assume that x 0 is a point of the subdivision, and that if x' is the next 
following point of subdivision, \x — x| < <5«. We shall then have for 
this subdivision: 

t>(x') = v(x 0 ) + |/(x') - /(x 0 )| g v(x 0 ) + f. (Ill) 

We must also have: 

7(x') g v(x') + €. (112) 

For, if V (x 1 ) exceeded v (x') + e, there would be some subdivision of 
a,x' with a sum exceeding this. But v(x') is that part of the sum used 
to form v coming from the interval a,x'. By using the new points for 
a,x r and the old points for x',b, we should have a sum for a,b exceeding 
v + *, and hence V, which contradicts the property of V as an upper 
bound. 

By the property of V (x<>) as an upper bound, 

v(xo) £ V(x 0 ). (113) 

We may deduce from the last three relations that 

F(x') £ 7(x 0 ) + 2e. (114) 

But V (x) increases monotonically with x, so that 

0 S 7<x') - 7(x 0 ) £ 2e, (115) 

and this relation holds if x' is replaced by any point between xo and x'. 
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Similarly, we may assume that the subdivision for v contains a point 
x n } the next point preceding x 0 , with \x n — x 0 | < d €) and deduce the 


relations: 

V(x 0 ) « »(*") + \f(x 0 ) - f(x") I g v(x") + 6 , (116) 

V(x 0 ) g v(x 0 ) + e, and v(x ") g 7(x"), (117) 

so that: V(x 0 ) g 7 (a:") + 2e. (118) 

Hence, since V (x) is monotonically increasing, 

0 ^ V(x 0 ) - 7(x") ^ 2e, (119) 

and x n may be replaced by any point between x n and Xo. 

The relations (115) and (119) show that 

\V(x) - 7(x 0 )| g 2e, (120) 

for any point x in the interval x ,r ^ x g a/, and hence for all x, such that 
\x — x 0 | < min (x — x n } x’ — x). (121) 


Since e and hence 2e is arbitrary, this shows that the function 7(x) is 
continuous at x 0 . 

Since the functions P(x) and Q(x ) are continuous when/(x) is con¬ 
tinuous, we see from equation (101) that: 

Any continuous function of bounded variation may be written as the 
difference of two continuous increasing functions . 


EXERCISES VII 

1 . Let P r denote the point set consisting of all points with rational coordi¬ 
nates on the closed interval 0 , 1 . If is the characteristic function of this set, 
as in section 148, show that for the interval 0,1 the upper integral of <f>(z) is 1 
and the lower integral of <£(x) is zero. 

2. Let F(x) and G(x) be each integrable functions on the integral 0,1, with 
F(x) S G(x) on this interval. If the function/(x) equals G(x) when x is a point 
of P r of problem 1 , and /(x) equals F(x) when x is not a point of P r , show that: 

T /(x) dx = f G(x) dx and f f(x) dx = f F(x) dx. 

Jo Jo sJLo Jo 

3 . Let Pi be any set of points on the interval 0,1 and P 2 be the set of points 
on the interval not in Pi. If every point of the interval is a limit point of points 
of Pi and also a limit point of points of P 2 , show that the results of problems 1 
and 2 are unchanged if we replace P r by Pi. 

4. Let the function /(x) be defined on the interval 0,1 by the following 
conditions: If x is irrational, /(x) = 0. At the end points, /(0) =»/(1) = L 
For a rational value of x, p /q in its lowest terms, f(p jq) = 1 /q. Prove that the 
oscillation of/(x) is zero for irrational x, and is /(x) for rational x. 
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6 . Prove that the function/(x) of problem 4 is integrable on the interval, 0,1. 

6. Let g(g) be any function of q for which lim g(q) ® 0 as q —* + oo. Define 
f(x) as in problem 4, except at the points p (q , and put f(p jq) = g{q) t Prows 
that the results of problems 4 and 5 still hold. 

7. Cantor's ternary set is obtained by removing an enumerable sequence of 
open intervals from the closed interval 0,1 as follows: First remove the open 
interval 1 /3,2 /3, or middle-third open interval. Then remove the middle-third 
open interval from each interval that remains, and repeat the process indefinitely. 
Thus at the second stage two open intervals are removed, 1 /9,2 /9 and 7 /9,8 /9. 
At the nth stage 2 W_1 intervals each of length 1 /3 n are removed. Prove that 
this set is of content zero. Hint: After each step the intervals left have a total 
length 2 /3 that of the preceding stage. Hence after n steps the intervals left 
have a total length (2/3) w . But these contain all points of the set, and as 
n —► -f- , (2 /S) n —* 0. 

8* Let q be any number suoh that 0 < q < 1. Remove an open interval of 
length q from the interval 0,1, and then from each interval that remains remove 
an open interval contained in it q times its length. Repeat the process indefi¬ 
nitely, and let P q denote the set that is left. The special case where the intervals 
are centered, and q = 1 /3, is described in problem 7. Prove that the set P q is of 
content zero. Hint: By reasoning as in problem 7, show that the intervals left 
after n steps is (1 — q) n , which —► 0. 

9. We may form a set by the process of problem 8 using a sequence of num¬ 
bers qi, £s, • * • between 0 and 1 instead of a fixed number, using q n for all 
intervals at the nth stage. Show that the magnitude of the outer content of the 
set is lim (1 — </i)(l — qz) • • • (1 — q n ) as n becomes infinite. The limit always 
exists, since the product is positive and decreasing with n. 

10. If a sequence of positive numbers decreases with n, it approaches a limit, 
On—ta, If ai < 1, we may define a sequence of numbers q n successively, by 
setting qi 1 — oi, and for n > 1, q n = 1 — a*/a n -i. Show that by using 
these in place of the q n of problem 9, we obtain a set with content a. 

11 . Prove that the set obtained by removing an enumerable number of non¬ 
overlapping open intervals from a closed interval is a closed set. The sets of 
problems 7, 8, 9,10 are examples. Hint: Since any point not in the set is in an 
open interval composed of similar points, it is not a limit point of the set. Hence 
all limit points of the set are in the set, and it is closed. 

12. Prove, conversely to problem 11, that any closed set on a finite interval 
may be obtained by removing a suitable sequence of open intervals from a 
certain closed interval. Hint: the greatest lower bound of the set, a, is in the 
set. Similarly, for the least upper bound, b. The set is on a, b. If x is any 
point of a ,b not in the set it is in some open interval x',x" composed of similar 
points where x* and x n are in the set, so that the same interval is obtained if we 
start with any point of it distinct from x. Since such intervals do not overlap 
and are all on a,6, there are only a finite number whose length exceeds 1 /n, and 
they may be enumerated. 

13. If a function f(x) is continuous on each of the open intervals removed to 
form the set P q of problem 8, it is integrable on the interval 0,1. 



EXERCISES VII 


14 . Let P a denote the point set consisting of all points on the closed interval 
0,1 whose coordinates are algebraic numbers, as in Exercises II, problems 26, 30, 
and 33. Prove that the set P a is of measure zero, but of outer content 1. 

15 . By interpreting the meaning of the result of problem 14 that P a is of 
measure zero, deduce that there are points on the interval 0,1 not in P a . This 
proves again that there are transcendental numbers, a result of problem 34 of 
Exercises II. 

16 . Prove that if a set consists of a finite number of points, it is of content 
zero. Use this and the theorem of section 151 to deduce an alternative proof of 
the fact that a bounded function is integrable if it is monotonic. 

17 . If fix) is monotonic on the open interval a, b and as x —* a+,f(x) —* — oo, 
as x—*b~-, fix) —» -fco, f(x) is continuous except on an enumerable set of 
points. Hint: Put F{x) — t&rr 1 fix), and show that f(x) is continuous wherever 
Fix) is. But the argument of section 158 applies to Fix). 

18. If fix) is monotonic on any interval, it is continuous except on an enumer¬ 
able set of points. The interval may be open or closed, and may be replaced 
by the ranges — oo, +oo ; or — a>, b, or a,+°o. Hint: Reduce to a bounded 
function as in problem 17. 

19. Prove that, iifix) is bounded and integrable, then |/(z)| is integrable. 

20. Prove that if fix) satisfies a Lipschitz condition, equation (77) of section 
128, then fix) is of bounded variation. 

21. Prove that if g(x) is bounded and integrable, and f(x) = j* g{x) dx, 
then f{x) is of bounded variation. Also that for fix), V{x) = j* \g(x)\dx } 


dx and Q(x) = J* gi{x) dx , where gi{x) = 0 when g{x) £ 0, 

and gi{x) = g(x) when > 0; while g^{x) = 0 when g{x) ^ 0, and gzix) — 
g{x) when g(x) < 0. Compare problems 19 and 20. 




CHAPTER VIII 


EXTENSIONS AND APPLICATIONS OF INTEGRATION 

The process of integration defined in section 121 in certain cases 
determined the Riemann integral of a bounded function over an interval 
as the limi t of a special type of sum. Here we consider some modifica¬ 
tions of this fundamental definition of integration. 

We first discuss the Stieltjes integral, which is derived from two func¬ 
tions. We next consider a type of sum involving a function of several 
variables, each of which is in turn a function of a single variable. We 
show that, under certain conditions, the limits of sequences of such sums 
are Riemann integrals. Then we consider the improper integrals of the 
first kind, which are applicable to certain functions over an infinite 
range, and the improper integrals of the second kind, which are appli¬ 
cable to certain unbounded functions. 

Finally, we consider some geometric and physical interpretations of 
the various types of integrals. 

162. The Stieltjes Integral. Let the two functions f(x) and g(z) 
be each single-valued in the closed interval a,b. Consider an arbitrary 
division of the interval a, b into subintervals determined by the points 

a = x 0 < Xi < x 2 < • • • < x n = 6, (1) 

and choose any points & such that 

**-i ^ ^ ** (2) 

Then we may form the sum 

S = bf(Zi)[g(xi) - gfri-i)}, (3) 

i=l 

analogous to that used in section 121. This sum depends on the number 
«, the choice of the and the choice of the fc. 

Now consider any infinite discrete sequence of sums St of this type for 
which 

lim 8m = 0, (4) 

t — 

and where, as before, 


~ = max 5, and ~ , **** X \—^ < 
264 


( 5 ) 
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If, for any such sequence, the values of St approach a finite limit, and 
if this limit has the same value I $ for all such sequences, then Is is called 
the Stieltjes integral of the function f(x) with respect to the function 
g(x ), over the interval a,b. 

We speak of the sum S of equation (3) as a Stieltjes sum. If we define: 

% = g(xi) - g(xi- 1), (6) 

the Stieltjes sum (3) may be written: 

8 = im s 0 i. (7) 

i= 1 

For reasons similar to those stated in section 127, this suggests the 
notation for the Stieltjes integral: 

lim St = I s = f f(x) dg or f f(x)dg(x). (8) 

We say that/ (x) dg(x) has a Stieltjes integral if there is a unique limit / s . 

When we wish to refer to the sums and integrals of section 121, in con¬ 
tradistinction to those of this section, we shall call them Riemann sums 
and Riemann integrals. The Stieltjes integral, as defined in this section, 
includes the Riemann integral as the special case for which g[x) = x. 

163. A Sufficient Condition. We shall now show that, if f(x) is 
continuous on the closed interval a ,b and g{x) is monotonically increas¬ 
ing throughout the same closed interval, then/(x) dg(x) has a Stieltjes 
integral. 

Since the function g(x) is monotonically increasing, all the differences: 

Sgi = gfa) - g(xi-i) (9) 


will be positive or zero. 

Now select any positive rj and determine a <5 0 such that, for any two 
points Xi and x 2 in the closed interval, 


I/O 2 ) -/Oi)| < «, if 1*2 ~ *1 

V 

| < So, where e = . • 

g(b) - g(a) 

(10) 

We consider two sums: 



s = im) s gi 

and S' = im') S' gj , 

(ID 


y=i 


such that 



^l<N 

VII 

<3 

and 5^ g 

(12) 


where 5m is defined for the first sum by equation (5) and b f M is similarly 
defined for the second sum. These sums are analogous to the Riemann 
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sums in equation (9) of section 122. By reasoning similar to that used 
to derive equation (19) in section 122, we may show that, for the 
Stieltjes sums of equation (11), 

\S-S'\< hed"g k , (13) 

k** 1 

where p and x k are defined by equation (12) of section 122 and 

* n Qk = g(xH) - g(x' k U). (14) 

Since all the b"g k are positive or zero, and: 

£ b"g h - g(x'') - g{x' 0 f ) = g(b) - g(a), (15) 

it follows from the relation (13) and the last equation of (10) that: 

1 8 - S '| ^ e[g(b ) - g(a)) £ v . (16) 

We may now apply to this equation the argument based on equation 
(20) in section 122 and draw the following conclusions: Any sequence 
of Stieltjes sums (11) for which b M —> 0, approaches a limit. This limit, 
Is 1 1s the same for all such sequences. Any Stieltjes sum with 6m < 5 0 /2 
approximates the value of the integral to within rj. 

By similar reasoning, or by noting that if h(x) is monotonically 
decreasing, g(x) = — h(x ) is monotonically increasing, we may prove 
that the same results hold for monotonically decreasing functions. 
Accordingly, we formulate the theorem: 

The Stieltjes integral of f(x) dg(x ) exists in any closed interval in which 
f(x) is continuous and g(x) is monotonic. 

164. Duhamel Stuns. Let 

yj = fj(x), j - 1, 2, - • •, k (17) 

be k continuous functions of the variable x in the closed interval a,5. 
If A, is the minimum and Bj the maximum of the function f 3 (x), the 
values of yj will all lie in the fc-dimensional interval: 

K : Aj ^ yj ^ Bj. (18) 

Next let 

F(yj) « F(y u y 2 > • • ■, y k ) (19) 

be a continuous function of the k variables yj throughout the closed 
interval K. Then, by section 35, F{yf) is uniformly continuous in this 
closed interval, is bounded, and takes on its maximum and minimum 
values. 
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If we consider the equations (19) and (17) as defining F as a function 
of x, 

G(x) = F\fj{x)], (20) 

this will be a continuous function of x throughout the closed interval 
a,b by section 36. 

For any arbitrary subdivision of the interval a,b by points (1) we select 
k sets of points satisfying the relation (2). We denote the points of 
the jth set by fry so that, for j — 1 , 2, 3, • • •, k, 

Xi -1 g fry g Xi. (21) 

We now form the sum: 

S D = Z F[/y(fry)]5 t - where j = 1, 2, • • •, k, (22) 

*« 1 

and is defined by equation (5). We shall refer to a sum of this type 
as a Duhamel sum. 

We shall show that any sequence of Duhamel sums for which 

6m —► 0, where 8m = max $i, (23) 

approaches as a limit the Riemann integral: 

I = jf G(x)dx = £ F{fj(x)] dx. (24) 

To prove this, first select any positive v, define: 


€ = , » 
b — a 


(25) 

and determine a 8 ' of uniform continuity such that 



\F{y") - F( 1 /{)| < «, if \y'/ - y'\ < d'; j « 1, 2, • • 

■, k, 

(26) 

and and are in the closed interval K. 

Next select a 5" such that: 



!/,(*") - /;(*')! < for i = 1, 2, • • •, k if \z" - x'| 

< 6". 

(27) 

Now consider any Duhamel sum (22) with 5m < 5". 
satisfying equation (2) we have from equation (21): 

For any fr 

I$i 7 - €y| ^ 5", for j « 1, 2, 3, • • * , k. 


(28) 


It follows from this that: 

Wy(fry)] - I < <• 


( 29 ) 
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This enables us to compare the Duhamel sum S D with the Riemann 
sum for the same subdivision: 

s = £««<)«<- iw&Wi- ( 30 ) 

t«i »«i 

We find: 

( b-a)e^ V , (31) 

»«i 

by equation (25). 

Since $ is a Riemann sum for the integral (24), it follows from section 
122 that there is a 5 0 for the tj here used such that 


1 

Cq 

A 

if < ~ • 

(32) 

Consequently, 

8 m < min , 5 A ■ 


\I - S D I < 2i), if 

(33) 


This proves the theorem: 

Any sequence of Duhamel sums (22) involving one continuous function 
of k variables and k continuous functions of a single variable , formed for a 
sequence of subdivisions for which 5m —0, approaches as a limit the 
Riemann integral (24). 

If h(x) is any bounded function having a Riemann integral on the 
closed interval a,6, and if G(x) is a continuous function on this interval, 
the product h(x)G(x) will be bounded on this closed interval and con¬ 
tinuous at all points where h(x) is continuous. Thus, by the remarks 
at the end of section 156, the product will be integrable. Now consider 
any Riemann sum: 

s* Z h(£i)G(£i)8i t (34) 

<-i 

and the Duhamel sum formed for the same subdivision, with the function 
G(x) defined by equation (20): 

So - (35) 

t»i 

If JET is an upper bound for h(x) on the interval, we have 

|$ — $x)| £ Hr] when 5 m < $'/> (36) 

by reasoning similar to that used for equation (31). 

Now consider any sequence of values of S D , formed for subdivisions 
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with 8m —■> 0 . The sequence of values of S, formed for the same values 
of 8i and the same subdivisions, approach a limit: 

I - JT h(x)G(x) dx. (37) 

Since, for values sufficiently far out in the sequence, we shall have 
5m < and \I — S\ < 17 , for such values: 

I - (H +l) v < S D <1 + (H + 1 ) 77 , (38) 

which shows that the values of S D approach the limit I, since 17 is arbi¬ 
trary. 

166. Properties of Stieltjes Integrals. If the function g(x) has a 
derivative throughout the open interval a,b it follows from the law of 
the mean that, for a suitable value of £[ in the interval 

g(xi) - g(xi„ 1 ) = g'(£)(xi - x^) = g'(^)5i. (39) 

Consequently the Stieltjes sum (7) may be written: 

s = £ /(« % = £ mg’ubti. ( 40 ) 

i=l 1=1 

This is a Duhamel sum similar to that of equation (35), with k = 1. 
We may take either/(x) or g'(x) as the function h(x ) 7 and the other 
factor as the function G(x). Thus, if either of these functions is integra- 
ble, and the other continuous, any sequence of values for subdivisions 
with 5 m —> 0 will approach a limit, and that limit will be the Riemann 
integral 

J f(x)g'(x) dx (41) 


for all such sequences. In particular, this proves that: 

If fix) is an integrable function on the closed interval a,b and g(x) has a 
derivative g'(x), continuous on this closed interval , then f(x) dg(x) has a 
Stieltjes integral , which may be expressed as a Riemann integral of 
f{x)g\x): 


f fix) dg{x) = J f(x)g'(x) dx. 


(42) 


Now suppose that g(x) is monotonic on the closed interval a,b and that 
fix) has a continuous derivative on this interval. Then, by section 163, 

the Stieltjes integral f fix) dg{x) exists. And, by the theorem just 
proved, the Stieltjes integral f g(x) df(x) exists. 
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Now let us consider the identity: 

/<*"}&(*") - qW)] + o(x'Mx") -Six')) = 

f(x")g(x") -fix'W). 

We may deduce from this that: 

Z f(xi) dffi + ZffOt-i) Sfi - f{x n )g(x n ) - f(x 0 )g(xo) 

*/(*)»(«) • 


(43) 


(44) 


Since the last expression is independent of the subdivision, and the 
terms in the left member are particular Stieltjes sums for functions 
whose Stieltjes integrals exist, we find by taking a sequence of subdivi¬ 
sions with —> 0 that: 



f(x) dg{x) + § gix) df(x) = fix) gix) 


(45) 


This is equivalent to 

f fix) dg(x) = /(x) 0 (x)| - f g(x)f\x) dx. (46) 

v a 1 a a 


The last two equations have a formal similarity to the rule of integra¬ 
tion by parts, and we have proved that: 

If f(x) has a derivative f f (x) which is continuous on the closed interval 
u,b, and if g(x) is a monotonic function on this interval , the evaluation of 
(he Stieltjes integral of f{x) dg(x) may be reduced to the evaluation of a 
Riemann integral by an integration by parts , according to equation (46). 

We note that the Stieltjes integral is linear in f(x) and also linear in 
g(x). That is, multiplying either f (x) or g ( x ) by a constant k multiplies 
the integral by k. Also 


and 


X b pb pb 

udg + J vdg = J (w + v) dg, 

X b pb pb 

f du + J f dv = J f diu + v), 


(47) 

(48) 


if the integral on the right exists. If / is continuous, and u and v are both 
monotonically increasing, this will necessarily be the case. If one is 
incareasing and the other decreasing, the integral on the right may not 
exist in the sense of section 162. In this case the expression on the right 
of equation (48) is sometimes defined as the value of the left member, 
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which is the same for any decomposition of the function of bounded 
variation (u + v) into the sum of two monotonic functions. 

The Stieltjes integral of fix) dg(x) is unchanged by the addition of a 
constant to the function g(x). 

When g{$) is a monotonically increasing function, the bgi are all 
positive or zero. Hence most of the discussion of section 124 may be 
applied to the Stieltjes integral of f{x) dg (x). In particular, if m and M 
are bounds for fix) in the closed interval a, b and gix) is monotonically 
increasing in this interval: 

m[g(b) - 0 (a)] ^ f fix) dg g M[g(b) - 0 (a)]. (49) 


166. Improper Integrals of the First Kind. So far we have only 
considered finite intervals, determined by finite limits of the integrals. 
Let us now consider a function /(x), integrable over the interval a,x for 
all values of x ^ a. If, as x —■» + 00 , the integral approaches a finite 
limit, we write: 



lim 

X —►+0C 



L. 


(50) 


We say that the integral on the left converges when there is a finite limit, 
or converges to L to indicate the limit approached. When no finite 
limit is approached as x —* + 00 , we say that the integral diverges , or fails 
to converge. 

By the Cauchy convergence criterion, the limit will exist if and only if, 
for each positive e, there is a value such that: 


p x " p x ' 

J fiu) du — J fin) du 


< c, for any x n > x f > X € . (51) 


Now suppose that p(x) is a function w T hose values are all greater than 
or equal to zero for all x ^ A ^ a, and that 


Then 


|/0c)| ^ p(x), if x t A. 





(52) 


(53) 


But, since p(x) Si 0 , 
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The last two relations show that any X € for the function p(x) will 
serve as an X t for /(x). This enables us to deduce the convergence of 
the integral 



from that of 



(55) 


The integral of p(x) from A to x increases monotonically with x. 
Hence I p (x) dx must converge if there is an upper bound to the values 

**A 

of I p(x) dx for all x > A. 

** A 

With the same conventions made for the relation (50), we write: 

I f(x) dx = lim f f(u) du. (56) 

«/_QO X—► —CO «/* 


We also define: 


f f{x) dx = f° f(x) dx + f f(x) dx, (57) 

v_oo V —00 v a 


and extend the definition : 


J* /(*) dx = - J fix) dx, 


(58) 


so that it applies when the limits a,b are replaced by a,oo ; by — <x>,a; 
or by “ 0 o,oo. 

All of the integrals of this section, defined in terms of a bounded func¬ 
tion on an infinite interval by a process derived from, but not identical 
with, that of section 121, are known as improper Riemann integrals, or 
simply improper integrals of the first kind. 

Improper Stieltjes integrals with infinite limits are defined in a similar 
manner. We may show that if /(x) and p (x) are two functions for which 
the relation (52) holds, and g{x) is monotonically increasing, the con¬ 
vergence of 


J P( x ) dg{x) implies that of J f(x) dg(x). (59) 

llj Improper Integrals of the Second Kind. If the function /(x) 
Abounded in the closed interval a,c the process of integration 
3 d in section 121 is not applicable for this interval. But, if the 
function is bounded and integrable over the interval a,x for every value 




Abt. 168] 


BOUNDED FUNCTIONS 


273 


of x in the open interval a,c, and if the integral approaches a finite limit 
as x —» c—, we write 



(60) 


and say that the integral on the left converges. We say it diverges if it 
does not converge. 

As in the last section, we may conclude that if 

p(x) ^ 0 and |/(x)| g p{x) for a ^ A S x < c, (61) 


the convergence of 


J p{x) dx implies that of J f(x) dx. (62) 


Moreover, the integral of p(x) over A,c must converge if there is an upper 
bound to the values of I p(x) dx for all A < x < c. 

J A 

Similarly, we use 



(63) 


as the definition of the left member, if f(x) is unbounded in the closed 
interval c,b but is such that the limit on the right exists. 

We extend the relation 


J /(x)dx = J fix) dx + J f(x)dx, 


(64) 


which holds when all the integrals are proper Riemann integrals, to 
define the integral on the left when one or both of the integrals on the 
right are defined by equations (60) or (63). 

All of the integrals of this section, defined in terms of a function not 
bounded on a finite interval, but bounded and integrable if we omit all 
points belonging to any open interval including a point c, are known as 
improper integrals of the second kind. 

168. Bounded Functions. We have only used equations (60) and 
(63) as definitions of the left member when the function f(x) was 
unbounded in every open interval including the point c. Suppose, now, 
that/(x) is bounded on the closed interval a,c and integrable over the 
interval a,x for every value of x in the open interval a,c. Then if we 
take any finite value as the value of f(x) at c, the resulting function 
will be integrable on the closed interval a,c as we proceed to show. 

This will follow from the theorem of section 156 if we show that the 
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points of discontinuity of fix) on a,c form a set of measure zero. Select 
any positive ij . Then, since fix) is integrable on a,c — i>, the points of 
discontinuity of fix) on the closed interval a,c — ij form a set of measure 
zero and hence may be included in an enumerable set of intervals G of 
total length < ij. But these intervals, together with the closed interval 
c — ij,c include all the points D, and have a total length < 2ij. Since 
i) is arbitrary, this proves our contention that D is of measure zero. 

By the convention made in section 149, we may leave f(x) undefined 
at c, and still consider fix) integrable on the closed interval a,c. Thus 
the integral in the left member of equation (60) is already defined. 

However, in this case J* f(u) du is a continuous function of x in the 

closed interval, by section 127, so that equation (60) holds. 

This proves that we may use equation (60) whenever the limit on the 
right exists, without verifying that the function is unbounded. Similar 
remarks apply to equation (63). 

169. Improper Integrals. Let the interval a,b be composed of n 
intervals c,_i,c< where 

a = Co < ci < C 2 < • • ■ < c n — b. (65) 


Then, if the integral of fix) is defined for each of the intervals 
either as a proper integral, or as an improper integral of the second kind 
by equations similar to (60) or (63), we define: 


f b mdx= £ r m dx. 

*“* 1 ^ Ct~\ 


( 66 ) 


We use a similar equation if a,b is replaced by — <x>,b; by a, <*> or by 
— ao, o°, provided the improper integrals of the first kind so introduced 
converge and are defined by equations similar to equations (50) or (56). 

The equation (66) enables us to reduce the evaluation of any improper 
integral of the kind here considered to that of a finite number of integrals 
of elementary type. 

Such integrals may sometimes be computed by the methods of section 
126. We proved there that if f(x) — F'(x) was an integrable function 
over the interval a,b then 


J fix) dx = Fib) - Fia). 


(67) 


consider equation (50). Suppose that F'ix) = fix) for all 
vhere/(x) is integrable over every interval a,x. If we write 


Fix) 


00 


a 


lim Fix) — Fia), 

J0-+-H© 


( 68 ) 
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when the limit on the right exists, we have: 



dx = F( x) 


( 68 ) 


We may also conclude that if the limit on the right in the equation (68) 
does not exist as a finite limit, the integral on the left in equation (69) 
does not converge. 

Consider next equation (60). Suppose that F'(x) — f(x) for all x 
in the open interval a,c where f(x) is integrable in every interval r. 
If we write 


F(c—) — lim F(x) 

x~+c— 


(70) 


when the limit on the right exists, we have: 



dx = F(x) 


F(c-) - F(a). 


(71) 


We may also conclude that if the limit on the right in equation (70) does 
not exist as a finite limit, the integral on the left in equation (71) does not 
converge. 

If F(x) is related to f(x) by F'(x) = f(x) for all x in each of the n 
open intervals c t _i,c; and the integrals of elementary type in equation 
(66) all exist, we have: 

f f(x) dx = £ [F( Ci ~) - F(e i . l +)], (72) 

J a i -1 


where F(c+) is defined by an equation similar to (70). 

Whenever F(c~) = F(a+), the terms involving c* on the right in 
equation (72) will cancel. In particular, if F(a;) is continuous 
throughout the closed interval a,b the equation (72) may be replaced by: 



f(x) dx = F(b) - F(a). 


(73) 


The equation (72) may also be used for proper integrals, provided the 
interval may be decomposed into a finite number of intervals for 
each of which an indefinite integral F(x) may be found. 

When we change the variable in an integral by a substitution, either 
to simplify its evaluation or for some other purpose, we may convert a 
proper integral into an improper integral, or vice versa. For example, 
if * «= 1/m, 



du == 1, 


(74) 
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and 


J r 1 dx r* - 

oV~ x ~X u 


du 


(75) 


In this case an improper integral of the second kind is converted into one 
of the first kind. 

As examples of equations (69) and (71) we have: 


and 


r x dx _ 

Jo 1 + X 2 


f 

**0 


+ 

dx 


tan 


vr 


= sin 1 x 



(76) 

(77) 


The introduction of improper integrals enables us to consider certain 
special values of the limits in the integrals of sections 137 through 144. 
For example, in section 141, we may take the upper limit for x as 1. 
This corresponds to <t> = w/2, since x = sin </>. The resulting elliptic 
integrals are known as the complete elliptic integrals. They are con¬ 
vergent improper integrals of the second kind when x is the variable, 
but become proper integrals in the variable (j>. 

170. Particular Convergent and Divergent Integrals. Since: 



dx = 


x~ a+1 
1 - a 


0L7± 1 


and 



dx = log x, 


(78) 


it follows that 


and 



dx converges if and only if a > 1, 



dx converges if and only if a < 1. 


(79) 

(80) 


Similarly, for any b > c, 



— c) ° dx converges if and only if a < 1. 


(81) 


We may conclude from this and equations (61) and (62) that, if F(x) 
is bounded and integrable in the closed interval c,b, the integral 


Jf 


(x — c) a F(x) dx converges if a < 1. 


(82) 


In particular, this will be true if F(x) is continuous throughout the 
closed interval c,b, or continuous except at c, with lim F(x) finite. 

X—**C+ 
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The same discussion applies if b < c, either to the integral as written or 
from b to c, if F(x') is continuous throughout the closed interval b,c or 
continuous except at c with lim F(x) finite. Equation (77) and the 

x—+c— 

complete elliptic integrals are examples with c = 1 as the upper limit, 
a = 1/2 and F(x) continuous. An example with lim F(x) = 1 is 


r h l 

I (x — c) 3 sin- dx. (83) 

J c x — c 

Again, assuming that lim F(x) is finite, 

J (x — c)~ a log (x — c)F(x ) dx converges if a < 1. (84) 

For we may write 

a = a! — pj with p > 0 and a! < 1, (85) 

and then put 

(x — c)~~ a log (x — c)F(x) = (x — c)~~ a '[(x — c) p log (x — c)]F(x). 


By section 92, lim (x — c) v log (x — c) = lim h p log h = 0, so that 

X —►C /l—►O 

when x —» c, the factor in the brackets approaches zero. Hence the 
integral in equation (84) converges by equation (82). 

Similarly, any factor which as x —» c is an infinity of lower order than 
any arbitrary positive power of (x — c) will not affect the convergence. 
Note that a may be zero in equation (84). 

Again, if P(x) is positive, has a positive lower bound, and is integrable 
in the closed interval c,6, the integral 

J (x — c)~ a P(x) dx diverges if a ^ 1 . (87) 

In fact, if this integral converged, it would imply that the integral of 
equation (81) converged for a value of a ^ 1. 

In particular, if P(x) is continuous except at c, and lim P(x) > 0, 


or lim P{x) = + <*>, the conclusion follows. When b < c, we consider 

X-+-C+ 

the lim as x —> c—. 

An argument similar to that used to prove equation (84) shows that 
J e lx ~ el v P(x) dx diverges, if p > 0. (88) 
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Mao the product of P(x) by any positive factor which, as x —> c+, is an 
infinity of higher order than (x — e) -1 used as an integrand leads to a 
divergent integral. 

From equation (79) we may conclude that, if F(x) is integrable over all 

the finite intervals A,x and lim F(x) is finite, then 

*—►+00 



dx converges if a > 1, 


(89) 


and any factor which, as x —* + «, is an infinity of lower order than any 
arbitrary positive power of x will not affect the convergence. 

Also, if P(x) is positive and integrable over all the finite intervals A,x 
and lim P(x) > 0, then 
#—►+00 


r 


x a P{x) dx diverges if a ^ 1. 


(90) 


This integral will diverge if the integrand is the product of P (x) by any 
positive function which, as x —►+<», is an infinity of higher order than 
x _1 . 

In section 144 we defined u(x), the inverse of the Weierstrass func¬ 
tion by conditions equivalent to the definition 



dx 

V4x 3 - g 2 x - g 3 


u(x). 


(91) 


That this integral converges follows from equation (89) with a = 3/2. 

171. Arc Length. A continuous sensed arc is any ordered set of points 
(x,y) in the plane which can be represented by two equations, 

x = /(«) and y = g(t), (92) 

for values of t in some closed interval a,b where these functions are each 
continuous throughout the closed interval. When the functions are 
such that if t' and t" are any two values each in the closed interval 

a£t£b, (93) 

the relations 

f(t') = f(t") and g(t') = g(t") imply that t' - t", (94) 

the correspondence between the points of the arc and the t interval 
(93) is one to one. An arc is said to be simple, if the parameter t can be 
so chosen that this is the case. 

The order relations of points on the arc is determined by the order of 
the corresponding values of f. This is the only geometrical significance 
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of the parameter. Two arcs consisting of the same points, in the same 
order, are considered identical. Thus 

* = t 2 , y = 0, -1 £ t £ 1 (95) 

and 

x = 1 - cos t, y = 0, - ^ g t g ^ (96) 

represent the same arc, but this arc is not simple. The arc 

x = t, j/ = 0, O^tg.1 (97) 

is a simple arc, identical with a portion of the arc given by equations (95) 
or (96). 

A polygonal line is an arc consisting of a finite number of straight line 
segments. We may obtain a polygonal line 
inscribed in an arc by selecting n — 1 inter¬ 
mediate values of t, 

a = < 0 < <i < t 2 <•••<<„ = b, (98) 

which determine n — 1 intermediate points of 
the arc, P„ and by joining each pair of con¬ 
secutive points P t _i,P t by a straight line seg¬ 
ment or chord. Any choice of n — 1 inter¬ 
mediate points Pi will determine a subdivision 
of the t interval similar to (98) for any choice of the parameter. Let 
L n denote the total length of the inscribed polygonal line. Let us put 

dti = U - i, Sxi = f(ti) - /(<,•_i), 8yi = g(ti) - p(k-i). (99) 

Then 

L n = £ Pi-iP. and Pi-yPi = V&c? + 5t/f. (100) 

«»i 

But, by reasoning as in section 98 we may show that 

|te<| ^ Pi-yPi, |fy,I 2? Pi-yPi and P,_iP, |fe,| + |5j/,|. (101) 

It follows that 

Z |5xj| or Z |5j/j| ^ L* % Z |5x<| + 2 |fy<|. (102) 

i=*l t**l i—1 

If t' and t" are any two values each in the closed interval (93), corre¬ 
sponding to the points P' and P", the length of P'P" is a continuous 
function of t' and t", and so takes on its maximum. This maximum 
chord is called the diameter of the arc. 
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If we consider any polygonal line such that (Im, the maximum diame¬ 
ter of any of the arcs P^iP;, is at most €, then any polygonal line 
obtained by inserting additional points of subdivision will have all its 
chords at most e. If every sequence of inscribed polygonal lines for 
which dm —> 0 leads to a sequence of values of L n approaching a limit L, 
the same for all such sequences, we say that the arc has a length L. We 
must use dM, instead of maximum chord, since our arcs are not necessar¬ 
ily simple. If, for example, our arc was like a figure 8, a subdivision of 
one of the loops might be considered to be a subdivision of the entire 
figure with all the chords small, but would have a polygonal length ap¬ 
proximating only one half of the total arc. 

The first sum of the relation (102) is similar to the sum v , for the 
function/(<)> used to obtain its variation as in section 159. Suppose the 
value of the sum is v 0 for any particular subdivision by intermediate 
values (98). Since v increases or remains unchanged when additional 
points of subdivision are added, there will be subdivisions with max 8ti 
arbitrarily small and with v ^ v 0 . And, since the functions f(t) and g(t) 
are uniformly continuous, there will be such subdivisions with the 
maximum oscillation of fit) and g(l) in any subarc arbitrarily small. 
Thus these subdivisions will have d M arbitrarily small. Since for such 
sums L n v ^ vq , if the limit L exists it will be at least v 0 and v 0 g L. 
Thus L is an upper bound for v for all subdivisions, and the function f(t) 
is of bounded variation. 

Similar reasoning may be used for g(t), and hence: 

If a continuous sensed arc has a finite arc length , the functions expressing 
the coordinates in terms of any parameter are each of bounded variation . 

To prove a converse result, suppose next that f(t) and g{t) are each 
of bounded variation. Then by equations (100) and (102): 

Ln = Z Pi-iPi ^ Z \tei\ + Z \tVi\. (103) 

*~1 »= 1 i= 1 

This shows that all the values of L n are less than the sum of the total 
variation of f(t) plus that of g(t) for the interval. Hence the values L n 
are bounded, and so have a least upper bound which we denote by L. 

The distances between any three points satisfy the relation: 

P^iPi £ P i —iP j + P jPt t (104) 

as we proved analytically in section 98. This shows that if we insert 
one additional point of subdivision Py between Pi_i and P t , the new 
value which replaces L n will be equal to or greater than L n * Moreover, 
since each of the new chords will be at most equal to the diameter of the 
arc, the increase in value can not exceed twice this diameter, or twice dM- 
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Since L is a least upper bound, there is a subdivision with a polygonal 
line of length exceeding L — e. Let the points of this subdivision be 
Pj y corresponding to tj. Suppose there are N — 1 interior points, and 
denote the polygonal length by ll N so that: 

L'n^L- e. (105) 

Now consider any subdivision with d M < ^ • Let its points of sub¬ 
division be Pi, corresponding to £,• of (98), and let its polygonal length 
be L n . Then 

L n g L. (106) 

Form a new subdivision by using the points Pi together with the points 

Pj distinct from all the P*. If this has m points, m < n + N. Denote 
the polygonal length by L". Since we have added to the P { less than N 
new points, which form at most 2 N new chords, each at most c/2 N, we 
have: 

L" SL n + 2N-^^L n + e. (107) 

But the subdivision which gave L" could be obtained from that which 
gave L' n by adding points of subdivision, so that: 

L'Jl ^ L' n . (108) 

We may deduce from the last four numbered inequalities that: 

L-2e^L n ^L. (109) 

This shows that, for any sequence of subdivisions for which d m —» 0, 
the numbers L n will differ from L by at most 2c, beyond a certain point 
in the sequence. Since c is arbitrary, we may conclude that lim L n = L, 
and the arc has a length. Thus: 

A continuous sensed arc has a finite arc length if the functions expressing 
the coordinates in terms of any parameter are each of bounded variation . 

In this case the arc length will be the least upper bound of the lengths of all 
inscribed polygonal lines , 

As we have defined it, arc length is independent of the choice of 
parameter, except as this determines order on the sensed arc. Thus arc 
length is a geometric quantity related to the sensed arc. 

172. Simple Arcs. For a simple arc, any sequence of subdivisions 
such that max Pi_iP» —> 0 is also a sequence for which dM —* 0, as we 
shall now prove. To do this, suppose that there is a sequence of sub¬ 
divisions with max P^Pi ~-»0, but such that dM does not approach zero. 
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Then for some positive «, for each integer n there would be a subdivision 
with du > e, and with max P,_iP,- < 1 /n, since for some e there would 
be subdivisions with dju > e arbitrarily far out in the sequence. This 
would enable us to find a pair of points on the curve for which 

chord PnP' n ' < — and diameter P„P" > e. (110) 

n 

But/(f) and g(t) are continuous functions, so that the chord P'P" 
corresponding to any two values of t, t' and t", is a continuous function 
of these two variables on a closed two-dimensional interval. Thus it is 
uniformly continuous, and there is a S such that 

P'P" < e , when 1 t" - t '| < S. (Ill) 

Since the arc P*P" contains some chord of length > e, it must include a 
pair of points whose values of t differ by more than S. Hence the values 
of f corresponding to Pf, and P", say and must differ by more than 
5, so that: 

I C - t'n I ^ 5. (112) 

Now keep e fixed, and let n take in succession the values 1, 2, 3, • • • . 
Either all of the points t' n coincide for sufficiently large values of n, or 
else the infinite set has at least one limit point, by section 9. In either 
case a subset of values of n can be selected such that the corresponding 
values of £ approach a limit, say to. Similarly, from these values of n 
a second subset of values of n can be selected, say m, such that the values 
of tj,' approach a limit, say t Then we have : 

Iim t' m = to and lim t„ — to (113) 

It follows from the relations (110), (112), and (113) that 

chord P'oP'o' = 0, — to\ ^5. (114) 

This contradicts the condition that the arc be simple, and hence proves 
the assumption that d*f does not approach zero was false. 

Thus for simple arcs, when max chord P,_iP, —► 0, dju —* 0. But from 
the definition of diameter, when dM —»0, max chord P,_iP,- —> 0. 
Hence, in defining the length of a simple continuous sensed arc, we may 
consider sequences for which max chord Pt_iP< —* 0, instead of those for 
which- 0. 

Variation. If /(f) is a continuous function of bounded variation 
op the closed interval a,b the equations 

* = /(f) and y = 0 


(115) 
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determine a continuous sensed arc, whose length is the total variation of 
/( t ) for the interval a,6. Since/ (t) is uniformly continuous, any sequence 
of subdivisions for which max 5ti —> 0 will be such that (1m 0. This 

proves: 

For a continuous function of bounded variationj the total variation 
V = lim \dfi\ for any sequence of subdivisions for which max Mi —► 0. 

174. Properties of Arc Length. From the corresponding properties 
of polygons, it follows that the arc length of a curve, or continuous sensed 
arc, as defined in section 171 is such that: 

If an arc is divided by a point into two arcs, the total length is the sum 
of the lengths of the two parts. That is, 

L b a = L c a + L b c , (116) 

where we use sub- and superscripts to denote the end points, as we do for 
integrals. As for the integrals, we may define 

L b a = —LI, (117) 

and write the preceding relation more symmetrically as 

L h a + LI + L a c = 0. (118) 

From the symmetry of this relation it will hold for any three values of 
a, b y c regardless of their order. 

If we denote the variation of f(t) from a to t by Vf ay and similarly that 
of g{t) by Vg l a y we may deduce from equation (102) and the preceding 
section that: 

Vfa or Vgl g g Vf a + Vg b a . (119) 

As this holds for any interval whose end points are in a,6, we may apply 
it to the interval t f t + h where t is in the open interval and h is sufficiently 
small. We may then deduce from the last part of the relation and the 
continuity of the variations which was proved in section 161 that the arc 
length is a continuous function of the values of t at the end points. Also, 
from the first part of the relation and the increasing character of the 
variations, we may deduce that Li increases monotonically with t. It 
will actually increase with t as t increases from t f to t", unless f(t) and 
g(t) each have zero variation for this interval t f \t n In this case, the 
functions are constant, and, for any t such that 

t' <>t£ t"y f(t) = /(*') and g(t) = g(t'). (120) 

Thus this can not happen in the case of a simple arc. In fact, since 
broken lines are at least as great as their chords, the same is true of arc 



284 


EXTENSIONS OF INTEGRATION 


[Chap. VIII 


lengths, and if P’ and P" are distinct points, and t' and t" corresponding 
values of the parameter we shall have: 

La £ L*a if t' ^ t". (121) 

The only function of the parameter was to order the points. The last 
relation shows that the points will be correctly ordered if we take the arc 
length itself, 

s = L l a , (122) 

as the parameter. In this way we obtain a representation of the arc: 

x = FO), y = G(s), (123) 

with geometric significance. These functions will each be continuous, 
since we may conclude from equation (101) that: 

\8xi\ or \b Vi \ ^ P^P, g fa* (124) 

176. Integral for Arc Length. Now suppose that for some choice of 
the parameter t, the functions fit) and g(t) each have derivatives con¬ 
tinuous over the closed interval a,b. In this case the functions f(t) and 
g(t) will necessarily be of bounded variation, as we proceed to show. By 
the law of the mean, 

Vi-m -/(fe-i) (i25) 

for a suitable choice of t[ in the interval Hence 

£ Wi\ = £ (126) 

1=1 1=1 

When we let max bU —* 0, the right member approaches a limit by section 
122. Hence the sum on the left is bounded, and the function is of 
bounded variation. In fact, by section 173 we find from the limiting 
relation: 

VJ* = jf 1/(01 dt. (127) 

A similar argument applies to g(t). 

It follows from the last theorem of section 171 that the curve has an 
arc length. To express this as an integral, we first deduce from equa¬ 
tion (125) and the similar equation for g(t) that: 

£ V5/? + 6g? = £ V[/«')] 2 + WWW 2 Sk. (128) 

i«.l 

As this is a Duhamel sum, and the functions are continuous, by the 
theorem of section 164, for any sequence of subdivisions for which 
max or 5m —* 0, this approaches a Riemann integral. Since any 
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such sequence corresponds to a sequence of subdivisions with dit —> 0, 
the polygonal lengths will approach L. It follows that: 

X b _ 

^[fW+VM 2 dt. (129) 

If we denote the integral from a to t by s, we have, since the integrand 
is continuous: 

rfc. _ 

J t = ^WWTwW. ( 130 ) 

As a consequence of this: 

ds 2 = dx 2 + dy 2 . ( 131 ) 

176. Ratio of Arc to Chord. Let us consider the ratio of an arc join¬ 
ing two points corresponding to ti and t 2 , to the corresponding chord. 
For the chord we have as in equation (126) 

PiP 2 = v'WWW + WWW 2 St, ( 132 ) 


where t r and t n are two suitable values between ti and t 2 . But, since 
the integrand of equation (129) is continuous, we have by the mean value 
theorem for integrals 


arc P1P2 = f V V'(t)] 2 + [g'(t)} 2 dt 


= V[/'«'")] 2 + [ff'(<"')] 2 «. 

This shows that 

(133) 

chord PxP 2 V[ f'(t’)} 2 + [g'(t")l 2 . 

arc PxP 2 V[f'(t'")] 2 + [| j'(t "')] 2 

(134) 


Next suppose P 0 is a point corresponding to to, and that/'(£o) and 
g'(to) are not both zero. Then if Pi approaches Po,h approaches to. 
For, suppose that/' (to) 9 * 0. Then if f(t 0 ) = M, for a suitable h, 


~ and \f'{t)\>- if |*-*ol<»- (135) 

Hence, if \h — fol < K 

PiPoZ j\h-to\, (136) 

since we may replace P 2 by P<> in equation (132). This proves that 
|<x — < 0 | must approach zero with PiPq. Similarly if P 2 approaches 
Po, h approaches t 0 . 
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Now let Pj and P 2 each approach P 0 . Then h and ta each approach 
to. Hence t', t" and t'" in equation (134) each approach to. Since the 
numerator and denominator each approach the same non-zero limit, it 
follows that the right member of equation (134) approaches unity. 

If we use the procedure of section 61, and recall equation (131), we 
may determine an angle <j> such that: 

dx = ds cos <f>, dy = ds sin 4 >. (137) 

Since these equations make 

^ = tan <S>, (138) 

dx 

4> is the slope angle of the curve. 

We may take s as the parameter, as in equation (123). If, when we 
do this, 0 is a continuous function of s , we say that the curve has a con¬ 
tinuously turning tangent, or is smooth. In this case we have from 
equations (137): 

F'(s) = — = cos <t> , and G f (s) = = sin <f> . (139) 

ds ds 

Thus the derivatives are continuous functions of the parameter s f and 
are never both zero since cos 2 0 + sin 2 0=1. Hence for a smooth 
curve, we may take any point as the point P Q of the above discussion. 

We note conversely that if, for some choice of the parameter, /(0 and 
g(t) have continuous derivatives, never both zero, the curve is smooth. 
For in this case, by equation (130), ds/dt > 0, so that the function s(t) 
determines a continuous inverse function, t(s), and since tan 0 = 
0 is a continuous function of t and hence of s . 

We may summarize the principal result of this section in the follow¬ 
ing statement: 

If the two end points which determine an arc and a chord of a smooth 
curve each approach the same point of the curve t the ratio of the arc to the 
chord approaches unity . 

177* Material Curves. One of the fundamental concepts of theoreti¬ 
cal mechanics is the material particle, or mass point. The mass point 
is a point associated with a positive number. If the point is in a plane, 
and the mass is m, each triplet m, x, y determines a mass point. 

Let us next consider a particular arc of a smooth curve. If we 
associate with each subarc of this curve a mass proportional to its length, 

m b a = DLl, (140) 
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we determine a material curve which is homogeneous, or of constant 
density D. Let s denote the length of arc between one end and a vari¬ 
able point of our fundamental arc, and m(s) the corresponding mass. 
Then 

m(s) = Ds and m’J = D(s" - s'). (141) 

If we associate a positive continuous function D(s ) with a smooth 
arc, we determine a material curve of variable density. For subarcs the 
mass is given by: 

m(s) = f D(s ) ds and wi'” = 

Jo 


r 


D(s) ds. 


(142) 


The laws of mechanics for continuous systems are obtained by extend¬ 
ing those for a finite number of particles by the following process. We 
divide the continuous system into n parts, and replace each part by a 
single particle whose coordinates are those of some point of the part, 
and whose mass or force component is the total mass or force component 
of the part. Let Q n denote any expression with physical significance for 
the finite system of n particles. If, for any sequence of subdivisions 
such that the maximum diameter of the parts, d M 0, the expression 
Q n approaches one and the same limit Q, we assign to Q the same physical 
significance for the continuous system that Q n has for the n particles. 
We also extend any law involving one or more quantities Q n to the 
quantities Q . 

That the laws obtained in this way will not depend on the choice of 
coordinates, or of parameters follows from their significance for the 
finite systems. 

Our method of extending the geometric concept of length from polygo¬ 
nal lines to curved arc, while not identical with this process, was in 
principle similar to it. 

It is not always emphasized that the process merely suggests the new 
laws and definitions. It does not prove them, since a continuous system 
is not a large number of particles and additional assumptions are needed 
to derive laws for such systems. 

For systems of particles, the moment about the ?/~axis is given by: 

Mx = 22 xipii. (143) 

t«i 

For any subdivision of a material curve, this leads to 

ix{si)Wi) **, 


(144) 
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where s< is the arc length to an arbitrary point of the ith part, and s” is 
the value obtained by applying the law of the mean for integrals to 

f D(s)ds = D(s!')6si, (145) 

which represents the mass of the nth part by equation (142). Since 
the functions in the Duhamel sum (144) are continuous, it follows that 
a limit is approached when <Im —> 0, and hence max 5s* —»0. We define 
this limit as the moment of the material arc about the y- axis, and write 


m(s)x(s) = I x(s)D(s) ds, 

J 0 


(146) 


Since the left member of equation (143) is the product of the x coordi¬ 
nate of the center of gravity by the total mass for the system of n parti¬ 
cles, we give a similar significance to the left member of equation (146). 
The factor m(s) is defined by equation (142), and equation (146) then 
defines x($), the x coordinate of the center of gravity for the material 
curve. 

The moment about the #-axis, and y(s ), are similarly defined. Thus 
we have 


m(s)y(s) = I y(s)D(s) ds, 

Jo 


(147) 


and the moment about any line in the plane may be found from these as 
for particles. Similarly, from the products of inertia for the system 
of particles in a plane we are led to define: 





(148) 


The moment of inertia about any line is obtained from the integrals in 
the same way it is found from the corresponding sums for particles. 

178. Specific Force. We may associate a continuous function P z (s) 
with a material curve, the applied specific force in the x direction. The 
total force in the x direction for any part of the curve is then determined 
by 

f 

Jo 

The second expression is the force on a subarc with end points s' and s". 
S|WI$ar definitions apply for the component in the y direction, and for 
th#t perpendicular to the plane, or in the z direction. 

If all the applied forces are in the same direction, say parallel to the 


P x (s) ds or F a 


_// _/ 

-/ 


P*(s) ds. 


(149) 
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2/~axis, we may define the x coordinate of their resultant by an equation 
similar to equation (146) for x(s). The process of the preceding section 
also leads us to define the total moment about any line for the forces 
applied to the system in terms of such integrals as 

y(s)P x (s)ds , (150) 

by equations similar to those which hold for sums. 

The laws of motion for rigid systems of particles may now be extended 
to such equations as: 

X s d 2 x P 8 d 2 x 

D(s) ds— 2 = P x (s ) ds, or m(s) -p = F x (s), (151) 

for the motion of translation of the center of gravity, and 

(X 2 + Y 2 )D(s) ds— 2 = J o (XPy - YP X ) ds, (152) 

for the rotation about the center of gravity, where 

X — x — x and Y — y — y (153) 

are the coordinates referred to the center of gravity. 

For the attraction of a particle on a unit mass located at the origin, 
we have for the specific force in the x direction: 



7 m x 

X 2 + y 2 Vx 2 + y 2 ’ 


(154) 


and the process of extension leads us to define the attraction of a material 
curve on a unit particle at the origin as a force whose x component is 

xD 

- 3 ds. (155) 

- (x 2 + y 2 f 

We note that in the theory of electricity the charge density is analo¬ 
gous to D, except that it may be negative as well as positive. 

179. Stieitjes Integrals. In our discussion of the last three sections, 
we assumed the density continuous and the curve smooth. Under these 
conditions, we may convert the integrals from integrals with respect to s 
to integrals with respect to other parameters, as x or y for restricted 
parts of the curve by using the results of section 175. 

However, as given our argument applies to any continuous curve 
which has an arc length, since for such a curve x and y are continuous 
functions of $. 
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Again, the function m(s) as defined by equation (142) has a deriva¬ 
tive, dm/da - D(s). We may relax this restriction, by merely requiring 
»»(*) to be any monotonically increasing function of s. In this case, 
we define the density as m'(s) for those values of s at which the function 
has a derivative. At other values the density is not defined. We 
replace D(s) ds by dm in equations (146), (147), and (148): these 
become Stieltjes integrals, which exist since x and y are continuous func¬ 
tions of s and since m is monotonically increasing. 

Similar remarks apply to the integrals of section 178, with P x (s) ds 
replaced by dF x , where F x is any function of s of bounded variation. 

These extensions enable us to treat the case of a material curve with 
continuous density, with a certain number of material particles attached 
to it, by one expression. Also the forces may either result from continu¬ 
ous specific forces or be applied at one point, like the continuous and 
point loads in the theory of beams. In such equations as (151) and 
(152) we frequently have a continuous density, but a simple sum on the 
right. The use of the Stieltjes integral is of more theoretical than practi¬ 
cal value here, since in any case where its value can be easily computed, 
this is done by reducing it to sums and Riemann integrals. 

180. Line Integrals. Let P(x,y ) be any continuous function of x 
and y in some two-dimensional region including all the points on an arc 
of a curve having an arc length. Along the arc, s' g s g s", the 
coordinates x{s) and y(s) will each be a continuous function of bounded 
variation. 

Let us form any subdivision of the arc by points (x,,?/,) corresponding 
to values 8* and form the sum 

S = l, P(x',y'') **, (156) 

»-i 

where x' corresponds to s', and y[' corresponds to s'', and s,' and s'' are 
any two values of s of the closed interval 

Since x(s) is continuous and of bounded variation, by section 161 we 
may write 

x(s) = f(8) - g(s), (157) 

where /(#) and g(s) are each continuous, increasing functions of s 
throughout the closed interval s',s". By section 37, if 

‘ p' - /(«'), p" * /(«") and q' - g(s'), q" = g(s"), (158) 

the equation p =* /(«) defines an inverse function s = f~ l (p), continu¬ 
ous and increasing throughout the closed interval p',p". Similarly the 
equation q — g(s) defines an inverse function, s = g~ l (q), continuous 
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and increasing throughout the closed interval q',q". And, by section 36, 
we may consider x = ®(s) and y = y{s) as continuous functions either 
of p or of q. Now write 

s - Z P(x'i,y'/) Spi - £ P(x-,y •') Sqi. (169) 

From the increasing relation of s to p, and p to s, if corresponds to 
Pi, the pi will determine a subdivision of p',p", and si and s" will corre¬ 
spond to values pi and pi' in the closed interval p<_i,p<. Thus the first 
sum is a Duhamel sum when p is the independent variable, and the 
second sum is a Duhamel sum when q is the independent variable. 
Moreover, from the fact that p is a uniformly continuous function of 8, 
any sequence of subdivisions for which dju —» 0 and hence Ss ,• —> 0,will be 
such that max Sp,- —* 0. Similarly it will make max Sq, —* 0. Thus, for 
any such sequence of subdivisions, by section 164, each of the sums will 
approach a Riemann integral, and the limit of S will be: 

f P(x,y) dp - f P(x,y ) dq. (160) 

*V •/fl¬ 

it is natural to abbreviate this expression as 

JP(x,y ) dx, (161) 

with the supplementary conditions: 

/ ^ s ^ s"j x - x(s), y = y(s). (162) 

The expression (161) is called a line integral. 

We may use any other parameter in place of $, provided that we use 
only sequences of subdivisions such that du 0. In some cases, analo¬ 
gous to the situation in section 165, some sequences with max —► 0 

or max bti —► 0, where U is the parameter, may not give the correct limit. 
When the arc is smooth, 

fP(x,y) dx = Jp[x(8),j/(s)]^d8, (163) 

since we may replace bpi — % by bX{ or x'is'/') b$i in equation (159), 
and regard this as a Duhamel sum for the integral in equation (163). 
In this case, for any parameter t such that s(t) has a continuous deriva¬ 
tive, 


JP(x,y) dx = JP[x(t),y(t)]^dt. 


(164) 
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The entire discussion applies with x and y interchanged to the line 
integral 

JQ(*,y) dy . (165) 

We usually consider the typical line integral in two variables to be of 
the form: 

J*P(x,y) dx + Q(x,y) dy, (166) 

with supplementary conditions similar to those in equation (162). This 
is defined to mean the sum of the two line integrals (161) and (165). 

181. Work. If a particle is under the influence of a force with com¬ 
ponents F z and F y , each being constant, the total work done by the force 
during any displacement from the point (xi,yi) to (x 2 ,y 2 ) is by definition 

F x (x 2 - xi) + F v {y 2 - yi), (167) 

Suppose a particle moves along any curve having an arc length, under 
the influence of a force with components F x {x,y) and F y (x,y). Such a 
variable force is called a force field. We shall assume that the particle 
remains inside some region in which each of the functions F x (x,y) and 
F v {x,y) is continuous. If we make a subdivision of the arc, s' S s g s" 
determined by points of subdivision St , and replace the variable force 
components in the subdivision by the values for x[,y", we are led 

to associate the sum 

£ F x (x',y'') 8 Xi + £ Fy{x',y[ f ) h Vi (168) 

i=l isol 

with the work done for successive displacements along the subarcs. In 
accordance with our general procedure, we take 

x[ — x(s[) and y” = y(s ")> (169) 

where s' and s'' each lie in the closed interval The discussion of 

the preceding section shows that, for any sequence of subdivisions for 
which dtf— >0, the sum (168) approaches one and the same limit, 
namely, the line integral 

f F x (x,y ) dx + F v (x,y) dy, (170) 

where 

s" and x = x(s), y — y(s). (171) 

We accordingly define the work done by the variable force or force 
field, for the displacement over the arc, as this line integral. 
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182. Impulse. For the motion of a particle of constant or variable 
mass m along the ar-axis, we have: 


i- '• 

dx 

where v = — • 
dt 

(172) 

If we define the momentum by 

K 

i 

.* 

ii 

•») 

& 


M — then 

(173) 


If we assume that F is a continuous function of the time, it follows 
that the momentum M has a continuous time derivative: 


dM 

dt 


= F. 


(174) 


Instead of requiring F to be continuous, we may start with M as a 
function of t and define the force as dM/dt at points where M has a 
derivative. At other points F is undefined. We then have: 


mv — 



(175) 


where the integral on the right is a Stieltjes integral. On any closed 
interval where F is continuous, in the integral dM may be replaced by 
Fdt. And, if an impulse I acts at time t we have: 



lim 

*-*o+ 

*-►0+ 



I. 


(176) 


183. Improper Integrals. Since the arc length is a continuous func¬ 
tion of the parameter, in any case where the discussion of section 1/5 
applies to every arc with end points in the open interval a,b, the arc 
length will be given by the integral from a to b if this exists as a proper or 
improper integral. These considerations also apply to the other inte¬ 
grals with physical meaning. For the arc length, an example is the 
quadrant of a circle defined by 

x = vT^l 5 , y = *, 0 g t £ 1, (177) 

for which 

u = 

184. *H g W Dimensions. With only minor modifications, most of 
the results on curves in two dimensions obtained in the last few sections 
apply to curves in three or more dimensions. In particular, such a curve 


X 


dt 


o vi - e 


(178) 
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has an arc length when all the coordinates are expressed in terms of a 
parameter by continuous functions of bounded variation. 

When all these functions have continuous derivatives, we have: 

f b JzLXCOl 2 dt. (179) 

' J a > 1 

likewise the discussion of material curves and the integrals and laws 
involving them applies in all essentials to material curves in three- 
dimensional space. 

The concept of line integral is also readily extended to three or more 
dimensions. 


EXERCISES VIII 


1. Let pi be n + 1 points on the closed interval a y b such that a = p 0 < Pi < 
p% < • • • < p n = b. Suppose that the function g{x) is monotonic in the closed 
interval a,6 and constant in each open interval pi-i r p k . If F(x) is continuous 
on a, b, show that 

f I Ffr) dgfr) = F(po)[g(po+) - g(po)] + Z f ? (p.)b(p.+) - ?(?.-)] 

Ja i = l 


(a) if pu < x < pk+i) and (b) if x == p k , with g(p k ) in place of 0(p*+). 

2. If G(x) = h(x) + g(x) t where h(x) has a continuous positive derivative 
and g(x) is the function of problem 1, show that 


r F(x) Mix) = r Fixwix) dx + r f^ 

J a J a J a 


the sum of a Riemann integral and the integral found in problem 1. 

3. If for each value of n } the numbers pi and qi satisfy the relations i — 1 S 
Pi ^ i and i — 1 ^ q% h prove that: 


n 1 

lim Z - 7==^.7= 

»=i v 2n — pi V 2n — 


7r 
6 


Hint: Identify with a Duhamel sum 


having 


x 


dx 


vT-~ 


■ as a limit. 


4u If F(g) is a continuous function of g , and g(x) has a derivative which is 
continuous and positive for the values considered, show that the value of the 
Riemann integral of F(g) dg from g(x\) to g{x 2 ) is equal to the value of the 
Stieltjes integral of F{g) dg from x\ to z 2 . 

6. If g{x) * 1, for 0 ^ x < 1, and g(x) = 4, for 1 < x ^ 2, evaluate the 

integral j $ dg{x). Hint: Use equation (46), or problem 1. The result is 3. 

Jq 

6. If P{x) is a polynomial of the nth degree with no real root > a, and 

p> -+ $ prove that J [JP(x>] dx converges. 

W J a 
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7. If P(x) is a polynomial with no roots in the closed interval a,b except c, 
and this is a multiple root of the rath order, prove that [P(a;)] v dx converges 
if mp < 1. 

J r»oo /too 

e~ xP dx converges. Also that I P(x)e~ xP dx 

a Jo 

converges, where P(x) is any polynomial. 

/too 

9. Show that J log \P(x)\ dx diverges if P(x) is any polynomial, not 


identically equal to 1. 

10. If r = r(0), x = r cos 0, and y — r sin 0, determine x and y in terms of the 
parameter 0, express the differential of arc in terms of 0, and hence show that in 
polar coordinates 

ds 2 = dr 2 + r 2 dd 2 . 


11. If o is the value of the slope angle for a curve at xo,yo , the equations of a 
circle tangent to the curve at x 0 ,y Q may be written: x — x 0 — R sin # 0 + R sin u , 
y — 2/o + R cos <l>o — R cos u, where it is a parameter. For the circle, when 
u = (t>o, x = xq, y - y 0 , dy jdx = tan # 0 and d 2 y jdx 2 = sec 3 <£ 0 /R . Verify that, 
for the curve d 2 y / dx 2 = sec 3 <j> d<t> Ids at any point. Hence, if R = ds [d<t> at 

o, the circle will have the same first and second derivative as the curve at 
x 0 ,yo. It is the circle of curvature of the curve at x 0) yo- The radius of cur¬ 
vature is p ~ ds /dcj), and the center of curvature is X = x — p sin <j> and 
Y — y + P cos <f>. 

12 . The locus of the center of curvature is the evolute of the curve. By 
problem 11, if x, y, </> and p = ds/d<t> are expressed in terms of any parameter, 
the equations of the evolute are: X = x — p sin <£ and Y = y + p cos <t>. Use 
these to show that the tangent to the evolute is normal to the original curve, and 
that for any two values of the parameter between which p preserves its sign the 
difference of the values of p for the two points equals the arc of the evolute between 
the corresponding points. Hint: dx = ds cos <£ = p cos <t> d<t> and dy = 
ds sin 0 = p sin <t> d<p. It follows that dX = —dp sin <p and dY = dp cos <t>, so 
that dY/dX = -cot <t>= (Y -y) /(X - x) and dS = |dp|. 

13. Using primes to denote differentiation with respect to the parameter, show 

[V2 i f/213/2 h 4 . y' 2 ] 3/2 

that p = -—— . This takes the familiar form ---> when x is 

x'y” - x"y' y 

the parameter. Hint: Differentiate tan <£ = y* / x ' and use p = s' /$' to elimi¬ 
nate 0'. 

14. If the parameter is the time, show that the acceleration has a tangential 
component dv/dt and a normal component ^/p, where v = ds/dt. Hint: Use 
problem 46 of Exercises V. 

16. If x and y are each elementary functions of a parameter, the equations 


X = x — y —- + y ^ and 7 = 2/ + X ,% . > determine X and 7 as 

y'V — x”y ' y * — x'V' 
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elementary functions of the parameter. From problems 12 and 13 deduce that 
the arc length of this curve is expressible as an elementary function of the 
parameter. Illustrate for x « a cos t and y ® b sin /. 

16 . If p is a given function of 0, the coordinates are determined in terms of 0 
to within additive constants, corresponding to the location of the origin. Prove 
that the coordinates and the arc length will all be elementary functions of 0 if 


j* pity, J* p sin0 d</>, and J* p cos 0 d<t> are elementary functions. 


17. By problem 16, if p is a rational function of sin 0 and cos 0 the coor¬ 

dinates and arc length will be elementary functions. Illustrate in the fol¬ 
lowing special cases: (a) p = sec 2 0, the catenary y = cosh x; (b) p — 
sec 2 0 esc 0, y *= (c) p = tan n 0 sec 2 0 esc 0, [(n + 1 )y] n = (nx) n+l . 

18. Show that the functions of problem 16 will be elementary if p is a rational 
function of sin (0 In) and cos (0/n), where n is an integer. An example is 
p = sin n ~ 2 (0/n), where in polar coordinates (n — l)r = n sin w ~ 1 [0/(n — 1)] 
and nB = (n — 1)0. 

19. Verify that the following simple algebraic curves have arc lengths expressi¬ 
ble in terms of elementary functions. (a) 2 / 2 = x 2 /3 + &z 3 ; (b) y 2 = x 2 /8 + bx 4 ; 
(c) y n = kx Wrfl , where n is a positive or negative integer. Part (c) is essentially 
the same as the curve in problem 17(c). 

20. If p is a polynomial in 0 and terms of the type cos a0, sin 60, and e c *; 
x, y , and s will be elementary functions of 0 as in problem 16. Here, however, 
they will be polynomials in 0 and the sines, cosines, and exponentials. Hence 


any integral of the form Jx n y m ds, where m and n are positive integers or zero, 


will be a function of 0 of the same type. Thus for such a curve, regarded as a 
homogeneous material curve, its center of gravity and moment of inertia about 
a coordinate axis will be elementary. Simple examples are: (a) p = 1, the 
circle; (b) p « 0, the involute of the circle; (c) p = e a4> , the equiangular spiral; 
(d) p = sin 0, the cycloid; (e) p = sin k<t> the epi- and hypo-cycloids. 

21. Suppose that for one curve x = 0), y = yi( 4 >), and a = $i(0), while for 

a second curve x = £2(0), y = 2/2(0), and s ~ §2(0)- Show that the curve 
with x « Xx (0) + a?2(0), y = 2/i(0) + 2 / 2 ( 0 ) has 0 as its slope angle, and 
* « 8 i( 0 ) + 82(0). This enables us to combine curves with simple expressions 
for their arcs to obtain new ones. 

22. If, for an arc of a curve for which p preserves its sign, we have 


p ■* — * /(0), prove that for the corresponding arc of the evolute we have 

d0 

JQ 

— = /'(0), if S is measured in the direction in which p increases. Show also 

d0 

that, if the evolute is referred to axes obtained from the original axes by a rota¬ 
tion in the proper direction through ir /2, 0 is the slope angle for the evolute. 

23 . Deduce from problem 22 that for the curves in problem 20, (a) is 
the evolute of (b); (c) and (d) have evolutes of the same size and shape as the 
original curve; and (e) has an evolute of the same shape as the original curve. 
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24. For a space curve with x as the parameter, y = y(x), and z = z(x), let 
primes denote differentiation with respect to x. Prove that, if 2 z' = y t2 t 
8 =* x + z + constant. Illustrate for y ~ x 2 , z — 2x 8 /3. 

25. As a generalization of problem 24, prove that, if 


/ = 1+ v’ 2 


(a + by’)* 


2a + 2 by' 

then s = ax + by + z + constant. If y is any function of x for which the 
expression has an elementary integral, this leads to a space curve with elementary 
arc length. 

26. Let c(x) be continuous, p(x) > 0, and P(x) — J* p(x) dx , a proper or 
improper integral for a ^ x ^ b. Then, for any x on the closed interval a, b the 


Stieltjes integral J* c(x) dP(x) equals the proper or improper Riemann integral 

/*x 

I c(x)p(x) dx. Hint: If S is a Stieltjes sum with such that the oscillation 
of c(x) in any interval < e, then J J* c(x)p(x) dx — c^SP^ S e $Pi, so that 
/ c(x)p(x) dx — S ^ eP(b). For improper integrals, as in section 169, we 

I t/ a 

need only treat the case where p(x) is unbounded near b. By the result for 
proper integrals, the two are equal on a,b — h. Let h—> 0. The limit of the 
Riemann integral exists, since p(x) is integrable. Hence the improper Stieltjes 
integral exists and equals the other. 


27. I jet u 


nx 

U dx and v — I V dx, where, if the integrals are improper, 

a a 

J f*b s*b 

|C/| dx and / \V\dx exist. Then the rule of integration by parts applies 

a 4 / a 

in the form J* uV dx = uv — J* Uv dx. Hint: Write u — u\ — 112 , where 

u\ = U or 0 according as U > 0 or not, U 2 — — U or 0 according as U < 0 or 
not, and similarly v = v\ — V 2 . This reduces the problem to the case where 
U and V are each §£ 0. By problem 26, the integrals may then be replaced by 

Stieltjes integrals, and the relation is J* u dv — uv — J* v du. This holds for 


proper Stieltjes integrals by section 165, and for improper ones we may take 
limits, since u and v are continuous. 



CHAPTER IX 


INFINITE SERIES AND INFINITE PRODUCTS 

The question of whether an infinite series converges or not, from one 
point of view, is a special case of the problem of determining whether a 
variable, defined for a discrete infinite sequence of values, approaches a 
limit. Thus many of the theorems concerning infinite series are immedi¬ 
ate corollaries of the results for limits proved in Chapter II. Our reason 
for not explicitly introducing infinite series earlier is that the discussion 
of certain tests for convergence is simplified by the use of integrals. 

After deducing a number of tests for the convergence of infinite series 
of real or complex terms, we define infinite products, and prove several 
theorems concerning such products and their convergence. 

186. Infinite Series, Convergence. Let u h wi y u 3 , . .. be any 
enumerated discrete sequence of real or complex numbers. Then the 
expression 

oo 

u x + U 2 + n 3 + • • • or £ U n , (1) 

n — 1 

sometimes abbreviated to is called an infinite series . The general 
term is u n , and is a function of n defined for positive integral values. The 
sum to n terms, or the nth partial sum, is 

n 

B„ = I = «i + l/ 2 + M3 + • ' ■ + U». (2) 

1 

We note that in this finite sum k is a dummy index, as defined in section 
127. 

A convergent series is one for which, as n becomes infinite, s n approaches 
a finite limit s. That is, 

s = lim s n . (3) 

n—>oo 

We call s the sum or value of the series, say that this series converges 
to 8, and write 

S = L U n . (4) 

n*=l 

By a real series we mean one for which the values of all the u n are real 
numbers. A series of complex terms, with 

U n = + ib ni 

298 


(5) 



Art. 187] ELEMENTARY TRANSFORMATIONS 299 

has as its partial sum 

n n 

s n = Uk + i £ ( 6 ) 

k = l k=l 

Consequently, by section 99, the series will converge if and only if the 
two real series with terms a n and b n converge. Moreover, when the 
series is convergent, 

s = X Un + i H b n . (7) 

n-1 n=l 

Thus the question of convergence of any series of complex terms is 
equivalent to a similar question for two real series, the real and imaginary 
component series. Also the sum of the series of complex terms is a simple 
combination of the sums of the two real series. 

186. Divergence. A divergent series is one which does not converge. 
For such a series, s n does not approach a finite limit. For a real series, 
if lim s n = + co , we say that the series diverges to infinity, and if 
lim s n = — oc , that it diverges to minus infinity. In all other cases 
where s n is real and the series diverges, the upper and lower limits of s n 
as defined in section 23 will be different. If these limits are both infinite, 
lim s n = + oo and lim s n = — qo , we say that the series oscillates 
infinitely. If the upper and lower limits are one infinite and one finite, 
we say that the series oscillates semi-infinitely. If the upper and lower 
limits are both finite and distinct we say that the series oscillates 
finitely. 

The behavior of a divergent series of complex terms is best described 
by applying the expressions just defined to its real and imaginary com¬ 
ponent series, which are both real series. We note that if the series of 
complex terms is divergent, one but not both of the component series 
may converge. 

187. Elementary Transformations. I. If a finite number of terms 
of a series are changed , the new series £ u n will converge or diverge with the 
old series , 

To prove this, let K be the largest subscript of a term changed. Then, 
for all n > K } we have: 

s n = s n S K* (8) 

This shows that si approaches a limit if and only if s n does. Also when 
either and hence both series converge, we have: 

s' = $ + Sjc ~ $K* 


(9) 
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II. The omission of a finite number of terms from the enumerated 
sequence of terms or the insertion of a finite number of terms in any positions 
does not affect the convergence or divergence of a series . 

To establish this, let the largest subscript of any of the p terms omitted 
be K , and let the sum of the terms omitted be T. Then, if we denote the 
nth partial sum of the new series by s', for all n > K, we have: 

$n ~ $n-}-p T . (10) 

Since n + p «o when n —> oo, si approaches a limit if and only if s n 
does. And, when both series converge, 

s' = s - T. (11) 

This proves the statement on omission of terms. The insertion of 
terms is merely the inverse operation. 

III. If C is a constant, distinct from zero, and u n — Cu n , the series 
converges or diverges with 

For, in this case 

s n * Cs n , (12) 

so that approaches a limit if and only if s n does. And, when both 
approach limits, 

s' = Cs. (13) 

We note that inserting parentheses in the expression for an infinite 
series as an unending sum has the effect of omitting certain values of s n . 
For example, 

(ui + U 2 ) + («3 + U 4 ) H- (14) 

may be regarded as an infinite series with u n = u 2n -i + u 2n . Thus 
*n ^ s 2 n, and the odd partial sums are omitted from consideration. 
Hence the insertion of parentheses will always change a convergent series 
into a convergent series with the same sum. The operation will also 
change a real series diverging to plus infinity, or to minus infinity, into 
a second real series with similar behavior. However, it may make an 
oscillating series converge. For example: 

1 — 1 -f- 1 — l + l — 1 + -.. oscillates finitely, (15) 

(1 — 1) + (1 — 1) + (1 — 1) + • • • converges to 0, (16) 

1 + (—1 + 1) + (—1 + 1) + • • • converges to 1. (17) 

The example shows that the omission of parentheses may change a 
convergent series to a divergent series. 
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188. The General Condition. Let us apply the Cauchy convergence 
criterion of section 99 to the variable s n . We note that 

Sfc+P s k *= Wjfc+l + Ujc+2 + * * * + Uk+p. (18) 

If p is an arbitrary positive integer, and k any integer exceeding N, then 
k and k + p will be any two distinct integers exceeding N. Conse¬ 
quently, from the condition that s n approaches a finite limit, it follows 
that: 

A necessary and sufficient condition for the convergence of the infinite 
series £w n is that , for any positive quantity €, there is some positive integer 
N t such that for any integer k > N t) and all positive integers p, 

Nfc+i U k+2 + * * • + W*+p| < €. (19) 

Although this condition is too general to be of much practical use as 
it stands, the necessary condition may be restricted to give a simple 
sufficient condition for divergence. To derive this, suppose that J^u n 
converges. Then the relation (19) holds for all positive p, and hence 
in particular for p = 1. Thus 

|w*+il < €, if k > N t . (20) 

That is, as k —> oo, lim u k = 0, and the individual terms of a convergent 
series must approach zero as we go out in the enumerated sequence. This 
condition is not enough to insure convergence, as we see from the series: 

l + i + | + i + 4 + i + 4+ | + * ,, > (21) 

formed of successive blocks of 2 n terms, each equal to l/2 n . The series 
diverges, since the sum to 2 k — 1 terms is k. 

However, it follows from the condition that if, as n —> «, u n does not 
approach zero, then J^u n diverges. 

189. Series and Limits. Every convergent series leads to a variable 
s n approaching a finite limit s. Conversely, every variable a n assuming 
a discrete set of values which approaches a finite limit 4asn~> <*>, may 
be related to a convergent series. For, if we put 

«1 = Oi, U k = a k - ojfc_x, k > 1, (22) 

we find 

Sn ~ ai+ ( a 2 — Ux) + ■ • • + ( a n — a n _x) = a n . (23) 

This shows that the series J^u n has its partial sums s n = a n , and so con¬ 
verges to the sum A . 

Similar relations hold between divergent series and variables a n 
assuming a discrete set of values which do not approach a finite limit as 
n co. 
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Thus from one point of view the terminology of infinite series merely 
furnishes a second notation for the behavior of discrete sequences, and 
results for series are theorems on enumerated sequences expressed in 
terms of the differences of consecutive elements. 

190. Positive Series. We call 2D w n a positive series if each of the 
terms u„ is real and positive or zero. We shall indicate this by writing 
p n in place of We treat such series separately because of their 
simplicity. Furthermore, we often deduce the convergence of other 
series from that of one or more positive series related to them. 

The positive series £p„ has 


s»+i — s„ - p n+ 1 ^ 0, so that s„+i S s„. (24) 

Thus s» is a monotonically increasing variable, and it follows from the 
theorem of section 27 that: 

A necessary and sufficient condition for the convergence of a positive series 
is that for all n there is some number M independent of n, such that: 


s„ ^ M. 


(25) 


191. Comparison Tests. Let 2DPn and £Pn be two positive series. 
We may deduce the convergence of the primed series from that of the 
unprimed series in the following cases: 


I. 

If p'n ^ Pn, 

II. 

If p'n - a n p 

III. 

If lim = 

n-*«o p n 

IV. 

If ^ ^ 


Pn 


Pn 


These may be proved as follows. In case I, s„ = s n , so that sD M 
if s n ^ M . Similarly, in case II, pD ^ Ap n , and s„ ^ AM if s n g M. 
In case III, we note that if n ^ N„ p'jpn < L + e. Thus, if L + « = 

oo oo 

A, Pn £ Ap n and by the condition II, 2- p' n converges with £ Pn. 

n**N n*&N 

oo 

But the addition of terms to the first series to obtain ]£ p f ni and the omis- 

71 = 1 

00 

sion of terms from 2D Pn to obtain the second series, has no effect on con- 

n*» 1 

vergenee, by the second result of section 187. Thus £pD converges 
with 2DPn in case III. 
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To prove case IV, we use the identity: 

Pn = Pn _ Vn-l . J>2 

Pi Pn-1 Pn —2 Pi 


(26) 


and the corresponding one for the pi.. It follows from these and the 
condition IV that 


Pi < Pn, 

P'l ~ Pi ’ 


(27) 


so that we may use condition II, with A - 


Pi' 

Pi 


Since the convergence of p n implies that of pi, the divergence of pi 
implies that of p n , under any of the above conditions. Since we are here 
starting with pi, it is more natural to state that we may deduce the 
divergence of the primed series from that of the unprimed series in the 
following cases: 

I'. If pi ^ p n> 

II'. If pi = b n p n and b n ^ B > 0, 


III'. 


IV'. 


If lim — = L > 0, 

n—►(» Pn 


or +oo. 


If 


Pn+l ^ 
Vn 


Vn+1 

Pn 


From the discussion of section 187 it follows that in cases I, II, and IV 
or I', II', and IV' the conclusion will follow if the conditions hold for all 
terms after some particular value N of n. 

192. The Integral Test. If f(x) is a positive , monotonically decreasing 
function of x, for all x greater than or equal to K, a fixed positive integer , 

and if the improper integral I f(x) dx converges , then the series with 

Jk 

Pn — f{n) converges , and conversely the integral will converge if the series 
does . 

To prove this, we first observe that 

/(fc) ^ f{x) g f(k - 1) for K S k - 1 ^ a; g fc, (28) 

in consequence of the monotonic character of f(x). As a monotonic 
function, f(x) is integrable over any of the finite intervals defined in 
equation (28), and we have: 

f{k) S f f(x) dx Sf(k— 1). 


(29) 
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Putting k *= K + 1, K + 2, * - * ,n and summing, we find: 

i /(*) g fm dx ^ r /(*). (30) 

k-R+l Jr k**K 

As the function/(x) is positive, the integral in this equation is monoton- 
ically increasing with n. Thus, if the integral converges as n —> <x>, it is 
bounded. Hence, by the first inequality the sum is bounded and the 
series converges. Again, if the series converges, the finite sum on the 
right is bounded, and by the second inequality, the integral is bounded 
and so converges, since it monotonically increases with the upper limit. 

Since the series and the integral converge together, they must diverge 
together. 

When both are convergent, we have: 

£ m ^ f six) d X ^ £/(*). (3i) 

fc-K+1 Jr k~K 


This test enables us to treat a number of series whose general terms 
are obtained from the integrals of section 170. In particular, we note 
that in consequence of equation (79) of that section, 


2 A converges if, and only if, a > 1. 
n 

(32) 

193. Geometric Series. Since 



1 + r + r 2 H- 

+ 

3 

11 

H-* 

7 1 
- \ 

(33) 

and 

lim r n+1 = 0, 

if 0 ^ r < 1, 

(34) 


n—wo 


the positive geometric series with p n = r n converges. This fact leads to 
the following results for positive series: 

I. <g r n^ljorattriyor aUn^N, then ^p n converges. This test 

Pn 

is a consequence of section 191, IV, with p' n = r n , so that Pn+i/ph - i’¬ 


ll. gj 1 for all n, or all n ^ N, then £ p n diverges. This is a 

^ pn 

consequence of section 191, IV', with p' n = 1, so that p' n +i/p f n = 1* 



ft „ ' — r •• 

diverges if L is greater than 1. 
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In the first case L < 1. Hence, if 


6 



« > 0 and 


t + i. 


(36) 


Let us use this as the e in the definition 
that 


Pn-t-l 

Pn 


L 


< «. 


if 


of a limit, and determine N so 
n > N. (36) 


This implies that 


— < L + e < 1, if n > N. (37) 


Hence we may use L + e as r and apply test I of this section to establish 
the convergence of £p n . 

In the second case L > 1. Hence if 

e = L - 1, e> 0 and L — c = 1. (38) 

Let us use this as the e in the definition of a limit, and determine N so 
that 


Vn 


< €, 


if n > N. 


(39) 


This implies that 


— > L - « £ 1, if n > AT. (40) 

Pn 


The divergence of ]£p n follows from this and test II of this section. 

The results I, II, and III which depend on the ratio Pn+i/Pn are 
separately or collectively known as the test-ratio test. 

A test which depends on the general term of the series is: 

IV. The series p n converges if ^Pn ^ r < 1 for all n, or all n ^ N, 
and diverges if^Pn ^ 1 for an infinite number of values of n. 

In the first case, 

if n ^ N y \fpn g r and p n ^ r n with r < 1. (41) 

Thus the convergence of £p n follows from test I of section 191, with 
Pn **r n . 

In the second case, since p n 1 for an infinite number of values, we 
cannot have lim p n = 0, and the series is divergent by the condition 
proved at the end of section 188. 
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From the meaning of upper limit, and IV, we may deduce: 

V. If lim < 1, the series converges, while if lim > 1, the 
series diverges. 

194. Harmonic Series. In equation (32) we proved that the har¬ 
monic series 


£ — converges if a > 1 and diverges if agl. 


n 


For this series we have: 


Pn ±i 
Pn 


(n + 

by equation (196) of section 83. 

Now consider any positive series with 


TT?~ + ») + 


Pn+1 

Vn 


= 1 


- 6 + »(i). 

n \n/ 


(42) 


(43) 


(44) 


This series converges if b > 1. To show this, we first select a value of a 
such that b > a > 1. This determines a convergent series with test- 
ratio given by equation (43). But we have: 


Pn-fl 
Vn 


Vn n \nj 


(45) 


Since b > a, (b — a)/n is positive. The additional terms are of higher 
order than this in 1/n so that for all sufficiently large values of n, say 


n > N, 


Pn-f-1 


Pn+1 ^ 

—— > 0, or 


Pn+1 . Pn+1 
Vn Vn 


(46) 


Vn Vn 

We now deduce the convergence of p f n from test IV of section 191. 

If the relation (44) holds with b < 1, the series £Pn diverges, as we 
could deduce from a similar argument based on test IV' of section 191, 
with £l/n as the comparison series, and a = 1 in equation (45). 

For positive series with 


Pn n \n log n) 


(47) 


we may obtain a theorem which includes the case 5=1. To do this we 

proceed M follows. For the positive, decreasing function,—^—> 
7 x log x 

we hmi: 


r 


dx 

x log x 


- log (log z) - log (log 2). 


(48) 
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When x —* + «, log x and log (log x) —*■ + » , so that the integral does 
not converge as x —> + ». Hence, by section 192, the series with 


Vn - -* n ^ 2, diverges. 

n log n 


For this series we have: 


Vn _ (n + 1) log (n + 1) 
Pn+i n log n 


(49) 


By the method of section 83, or problem 33 of Exercises IV, 


so that 

log (w + 1) 
log n 

Hence, 



(50) 


log n + log 



log n 


= 1 


1 


n log n 



(51) 


Vn = f 1+ l\ l0g (ft + 1) 
Vn+i \ n) log n 


1 +- + 
n 


1 

n log n 


+ o 



• (52) 


By the procedure of section 83, we may deduce from this for the 
reciprocal function: 


— = 1 + <>(-T)• 

p n n n log n \n log n / 


(53) 


Now consider a series whose test-ratio is given by equation (47) with 
b ^ 1. From equations (47) and (53) we have: 


Pn+l 

Vn 


Pn -\-1 1 b 


Vn 


n 


+ 


1 


n log n 


+ 


o(-r—Y (^) 

\n log 71/ 


Since the first term is positive or zero, the second positive, and the last 
of higher order than the first or second, it follows that the difference is 
positive for all sufficiently large values of n. Thus, by test IV 7 of sec¬ 
tion 191, the series 2*Pn diverges. 


Since terms o 



are also o 



, by the result for series with 


ratio in the form (44), the series with ratio in the form (47) converges if 
b > 1. Thus we may state as the complete result: 

If the test-ratio of a series is expressible in the form (47), the series cortr 
verges if b > 1, and diverges if b ^ 1. 
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are also 


We note that if q > 0, terms o or even 0 

o (—r-—)»by equation (293) of section 92. Thus, in particular, the 
\n log n/ 

b n + 0 (^i} 


series with 


P2±l = 1 

Pn 


Q> 0 , 


converges if b > 1 and diverges if b g 1. 

196. Practical Procedure. If p n is given explicitly as a function of 
n, we may express the test-ratio as a function of n. Suppose that there 
is a function/(x), continuous at x = 0, such that for some fixed value c 
and all sufficiently large n, 


Pn+l 

Pn 



(56) 


It is possible so to select the function that c — 0, but another choice 
may make/(x) take a simpler form. Then, if /(0) < 1, the series is con¬ 
vergent, and if/(0) > 1, the series is divergent by test III of section 193. 

If /(0) = 1, and the function f(x) has a finite second derivative at 
x = 0, by equations (188) and (189) of section 82 there is a development- 

f(h) = 1 + hf'( 0) + 0(h 2 ). (57) 


If we replace h by 1/(n + c) and observe that 

—-— = - —j- O ( 4) i and terms O (-——— 
n + c n \n ‘v \(n + c) 

we may deduce that 



Pn± 1 
Pn 



(58) 

(59) 


As this has the form of equation (55) with q - 1, and b = — /'(()), we 
conclude that the series under discussion is convergent if —/'(0) > 1, 
and divergent if —f'(0) g 1. Otherwise expressed, the series is con¬ 
vergent if /'(0) is negative and numerically greater than unity, 
f( 0) < — 1. The series is divergent if f'(0) is positive, or numerically 
less than or equal to unity, /'(0) ££ — 1. 

We iJM^ate this procedure for the binomial series, with 




m(m — 1 )(m — 2) •••(« — » + 1) 


x" 


f 


1-2-3. n 


(60) 
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when x = —1 and tn is not zero or a positive integer. For these values, 
the terms all have the same sign for n > ra. Hence, if we neglect the 
terms with n £ m, if there are any such, we obtain either a positive series, 
or one obtained from a positive series by multiplying each term by — 1, 
which does not affect either the convergence or the test-ratio. The test- 
ratio is 


so that 


u n +1 __ ft — m ra+1 

u n n + 1 n + 1 


(61) 


if c = 1 , f(x) = 1 - (m + l)x, f(0) = 1, f'(0) = - (m + 1 ). (62) 

Thus, when x = —1, the binomial series with general term given by 
equation (60) converges if m is positive, and diverges if m is negative. 
Although we excepted the cases of m zero or a positive integer from the 
discussion, we need not except them from the conclusion, since in the 
excepted cases the terms are all zero from a certain point on, and we have 
convergence. Thus the series converges for all values of m ^ 0, and 
diverges for all values of m < 0, when x = — 1. 

The procedure of this section applies to most of the useful positive 
series. It is generally the simplest in practice, particularly when 
p n+ 1 and p n have common factors. Occasionally, when p n is an nth 
power of a simple expression, the tests of section 193, IV and V, are 
practically the simplest. 

196. Absolute Convergence. For any infinite series of real or com¬ 
plex terms, J^u n} the series whose general term is \u n \ is a positive series. 
If this positive series converges, the original series necessarily converges. 
For, we have: 

l^fc+l + ^*+2 + * • • + Wfc 4 .pl |Wfc4i| + |nfc 4 2 | + • • • +|Wfc 4 p|, (63) 


so that the sum on the left will be numerically less than e if that on the 
right is. But, by the condition of section 188, if the positive series 
2|w n | converges, the sum on the right will be less than any fixed positive 
quantity €, for all positive p, and all k > N t} a suitably chosen number. 
Thus the sum on the left is numerically less than c, for all such choices of 
p and k } and by the sufficiency of the condition of section 188, the series 
J^Un converges. This proves: 

If £|w n | converges , then ^u n converges . 

When 2|w n | converges, the series ^u n is said to converge absolutely . 
Thus absolute convergence implies convergence. 

Any sufficient condition for the convergence of a positive series, when 
applied to £|w n |> may be used to prove the absolute convergence of 
2 > n . 
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In particular, we note that if 



for all sufficiently large integral values of n, where/(x) = |F(x)| is con¬ 
tinuous at x — 0, we have absolute convergence if /(0) < 1. Also if 
/(x) has a finite second derivative at x = 0, and/(0) = l,/'(0) < — 1, 
we have absolute convergence by section 195. 

Note that the tests for divergence of positive series, for example those 
of section 195, when applied to 2*|w»| may show that 3£w n does not con¬ 
verge absolutely, but do not necessarily prove that the series itself 
diverges. 

If 22u n converges, but J^\u n \ diverges, we say that ]£ u n converges 
conditionally . 

197. The Abel Identity. The principal method of proving the con¬ 
vergence of series not absolutely convergent rests on an identity which 
we proceed to discuss. 

Let a finite sequence of positive decreasing quantities be given: 

Pi ^ P2 ^ P3 ^ ^ Vn S 0, (65) 

and n real or complex quantities: 


Ml) M2, «3> • ■ ’ » M„. (66) 

Form the partial sums: 

Si = Ui, S 2 = Ml + U2, ■ ■ ■ , s„ = «1 + tl 2 + • • • + M») (67) 

and let M be an upper bound for their numerical values, 


M £ M, k = 1, 2, • • •, n. 


( 68 ) 


We shall prove that 


n 

Lp*«4 


k~ 1 


g PiM. 


(69) 


We have: 

n 

T, VkUk * Pl*l + P 2(«2 — Si) H-- + P»(s n — S„_i) (70) 

*-l 

““ *l(Pl - P 2 > + «s(P 2 “ P 3 ) H-f- Sn — 1 (Pn—1 ~ P„) + 8„p n . (71) 


This is the Abel identity. 
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The differences in the parentheses of the expression (71) are all posi¬ 
tive or zero, so that 

n n—1 

'LpWk £ D |s*|(p* - Pk+i) + |s»|p» (72) 

fc«*l A*1 

g M[(pi - p 2 ) + (p 2 - p 3 ) + • • • + (Pn—l - Pn) + p n ] (73) 

^ Mpi. (74) 

This is the inequality we were seeking to prove. 

Suppose next that the u k and hence the s k are real. Let M r and M " 
be bounds for all the s kl so that: 

M f Ss k ^ M". (75) 

In this case we may obtain an upper bound for the right member of 
equation (71) by replacing each s k by Jkf", and reducing the expression 
to M n pi, analogous to the deduction of equation (74). Similarly we 
obtain the lower bound M'pi, so that 

M'px g Z VkU k g M n p i. (76) 

198. The Bonnet Mean Value Theorem. As an application of the 
relation (76), we shall prove Bonnet’s form of the second mean value 
theorem for integrals. The theorem is: 

If f(x) is bounded and, integrable for a ^ x ^ 6 , and p(x) is positive 
and monotonically decreasing for a ^ x g 6, then 


J m P (x) ix - pia) f f(x) dx, 


for a suitably chosen value of £ in the closed interval aft. 

On the interval a, b the function p(x) is integrable by section 158. 
Hence f(x)p(x) is integrable by the final result of section 156 so that 
the integral in the left hand side of equation (77) exists. Also |/(x)| is 
integrable. 

We shall construct a sum which approximates the integral of f(x)p(x). 
We first select any po^tive number 6 , and determine a positive number r\ 
such that 


vf 1/0*0! 


dx < t. 


We then divide the interval from p(b) to p(a) into n equal parts, taking 
n so large that each part is less than 7 . That is, 

_ ^ p(a) - p{b) s = p(a) t . P ^I < 

n 
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We denote the points of subdivision by p*, so that: 

Pi = P(a), Pn+i = P(t>), Pk = Pi ~ (k - 1)3. (80) 

We shall associate with these n + 1 values x*. We take x t - a, 
Xn+i = b. For each intermediate Pk, we define x* as the least upper 
bound of points u k such that 

p(x) ^ Pk, for u k . (81) 

It follows that for the right and left hand limits, 


p(x*~) ^ Pk ^ p(xk+)- (82) 

Since p(x) is monotonically decreasing, and p* <£ Pk+u it follows that 
x k S Xfc+i. We may have equality for some values of k. If the in¬ 
equality holds, and 

Xk < x < Xk+i, Pk ^ p(x) ^ pk+i. (83) 

Let us define 

F(x) = p kl if x fc < x < x* +1 . (84) 

The function P(x) will be defined on a,b except at the points x k , finite in 
number. For all other values of x, 

0 g P(x) - p(x) ^ Pk~ Pk+i g 3 < v- (85) 


Consequently, we have: 


\f dx ~ f dx \ = “ **(*)] dx^ 

S t £ 6 |/(x)||p(x)-P(x)|dx 
g V f* \f(x)\ 


\ dx g e. 


( 86 ) 


But we may write: 


if 


I /(x)P(x) dx = £ p k I f(x) dx = 2 Pfc«ib, (87) 

a /fc-1 

r -f» 

/(x) dx, (88) 


so that ** 0 if Xi = Xj+i. From the relations (86) and (87): 

^ [ n /J> n 

f 4 L — e g I /(x)p(x) dx g 2 pi«i + e, (89) 

*>1 i-1 
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so that we have approximated the integral by a sum of the type to which 
the Abel identity applies. 

Next let M f and M" be the minimum and maximum values of the 
integral of /(<) from a to x, considered as a function of x. Then: 


M' sS J fit) dt g M", a g x g b. 


(90) 


Also, since the integral is a continuous function of its upper limit x, the 
values M' and M" are actually taken on for certain values of the upper 
limit, x' and x". 

If we form the sums s k of equation (67), using the u k of equation (88), 


Sfc 


r *+l S&k +1 

f{x) dx = J fit) dt. 


Consequently, from the relation (90), 

M' ^ s fc g M". 


(91) 


(92) 


As this has the same form as the relation (75), we may apply equation 
(76) and 


M'pi ^ £ PkUk S M"pi. 
1 

It follows from this and the relation (89) that: 


pb 

M'pi — e i£ J /(x)p(x) dx g M"pi 


+ «• 


(93) 


(94) 


But e is arbitrary, so that this relation remains true if we omit the terms 
— e and e. Recalling the definition of M' and M", we may write: 

Pi r fit ) dx g J /(x)p(x) dx g pi J fit) dx. (95) 


This shows that 


J f(x)p(x) dx is an intermediate value of pi J fit) dt, (96) 

considered as a function of x. Since it is a continuous function of x, the 
intermediate value must be taken on at some point £, and 

f /(x)p(x) dx = Pif a m dt, or p(a) I! fix) dx. (97) 

This is equation (77), the conclusion of the theorem. 
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199. The Abel Tests. Let £w„ be an infinite series, and 

Pi ^ P 2 ^ Vi S ^ Vn ^ ^ 0 (98) 

be a monotonically decreasing infinite sequence of positive numbers. 
Consider the series E)p n u„. By the general condition of convergence of 
section 188, the convergence of this series depends on the magnitude of 
the sums: 

P 

m=l 

If, for all positive p , we have 

£ U k + m s s k , ( 100 ) 

then by the relation (74), with slightly different notation, 

v 

iC Pk+mttk-\-m =2 Pk+l^k- (191) 

m *1 

If the series J^u n converges, the relation (100) may be satisfied by values 
of S k such that S k —» 0 as k —> co. Then, since the p n are monotonically 
decreasing, the right, and hence the left, member of equation (101) 

approaches zero as k —► co. Thus, by the condition of section 188, the 

series will converge. That is: 

If the series ^u n converges , and the p n form a monotonically decreasing 
sequence of positive numbers , then the series ^p n u n converges . 

A related result is: 

If the series is such that for some fixed S and all values of k, 

k 

u n S S, and if the p n form a monotonically decreasing sequence of 

n—l 

positive numbers approaching zero as a limit , then the series X \PnU n con¬ 
verges . 

For, in this case we have: 

p k-\-m k 

i, U k+m = E - I «« S 2S, (102) 

m**l n = l n» 1 

and hence 

2) Pk+mU/c+m — %Pk-\-\S> (103) 

mm 1 

which approaches zero as k -* <*>. 

In each of these two cases, if $ is a bound for all the partial sums 
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the sum of the series £p„u n is numerically at most piS, since it follows 
from the inequality (74) that 


p 

X PkUk 


n-1 


£ PlS. 


(104) 


We may establish the additional result: 

If the series £w n converges and the p n form a bounded monotonically 
increasing sequence of positive numbers, then the series 2 ,p n u n converges. 


For, if P is any upper bound for the p n> it follows from the inequality 
(74), applied to this sum taken in reverse order, that: 


£ 


m—1 


Pk+mUk+m\ 


= Pk+mSk = PSk, 


(105) 


which approaches 0 when k —> oo, since converges. 

200. Alternating Series. The series 1 — 1 + 1 — 1 + • • • has sums 
alternately 1 and 0. Accordingly all the partial sums are bounded. 
Hence, if we multiply in any monotonically decreasing positive sequence, 
p n , approaching zero as a limit, we obtain a convergent series: 


Pi ~ V 2 + P3 - P4 H-• 


(106) 


Also, since the partial sums of the original series admit unity as an upper 
bound, 


£ (-1 ) k+m p k+ m ^ Pk+ 2 ^ PHI' 

m=2 

It follows that the remainder of the series after k terms, 


(107) 


r (-i ) k+m p k + m = (- i) k+i Vk+ i + r (-i ) k+m p k+m , (los) 


is either zero or has the same sign as its first term, and does not exceed 
this first term in numerical value. 

When the p n decrease, so that p k+2 < Pk+ 1 , the remainder of the 
series has the same sign as its first term, and is numerically less than this 
first term. 

As an example of an alternating series, the series 

l - I + i - I + • • • ( 10Q ) 


converges. Here the p n decrease. 

The series 

1 — 1+J — + (HO) 

converges to 0. Here the remainders are alternately equal to their first 
term, and to zero. 
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201. Conditionally Convergent Series. It is shown in problems 10 
and 11 of Exercises IX that the sum of the series (109) is log 2, but that 
if we rearrange the terms, taking p positive to each q negative terms, then 
the sum is log (2 p 1,2 /q 112 ). 

This illustrates that the sum of a conditionally convergent series 
may change when we rearrange the terms. Consider any real condi¬ 
tionally convergent series. Let P„ denote the sum of those terms among 
the first n which are positive, and — Q„ the sum of those terms among 
the first n which are negative. Since the series converges, we have 
lim (P» — Q n ) — s, the sum of the series. But, as the series does not 

converge absolutely, we have 

lim (P„ + Q n ) = +», so that lim P„ = +» 

n~MC n—►ao 

and lira Q n = + 30 • 

Hence, after any finite number of terms are removed, we may still obtair 
from either P or Q a number of terms with an arbitrarily large sum, when 
P denotes the positive terms of the series taken in older, and Q the nega¬ 
tive terms with signs reversed, taken in order. This fact suggests a 
method of rearrangement of the series which will have any given number 
L, as a sum. We begin with the smallest number of positive terms from 
P, taken in order, which have a sum greater than L. Then we add the 
smallest number of terms from —Q to give a sum less than L. We then 
take additional terms, in order, from P to make the sum greater than L, 
additional terms from — Q to make the sum less than L, and continue in 
this way. The resulting series will have a sum L, since the difference 
between a partial sum and L will be less than the last term of P or Q 
used, and the individual terms approach zero since the series con¬ 
verges. 

Similarly, by using an increasing set of numbers in place of L at each 
stage, say n, we may make the new series diverge to plus infinity. Or, 
using — n, we could make the new series diverge to minus infinity. 

For series of complex terms, the real or imaginary component series 
may converge absolutely, but at least one of these series will converge 
conditionally, if the original series does. Hence there are rearrange¬ 
ments of the terms of the original complex series which will alter the 
sum. ' 

202. Rearrangement of Absolutely Convergent Series. If a series 
converges absolutely, its sum is independent of the order in which the 
terms are summed. For, let £u„ be an absolutely convergent series, and 
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Z u' the same terms taken in a different order. Select an N such that for 
every positive integer p, 

P 

Z |u»+ml < e, if n > N. (Ill) 

7TI * 1 

Then, for any n\ > N and n 2 > n\ + pi such that all the terms of 

ni 

£ u n are included in Z) we have: 

n«1 n»l 

E - Z ^ Z § I lUjjfcl, (112) 

n**l n»l fc«l fc=l 

where uj k denotes a term with subscript exceeding m. If the largest of 
these subscripts is ni + p 2 , we have: 

Z* Wjk\ ^ X) ^ €. (113) 

A: =» 1 m«l 

Since n 2 becomes infinite when ni does, this proves that 

Z < = £ (114) 

n=l n = 1 

The result may be applied to £ W and £ )■ u n |, so that the latter series 
converges, and the rearranged series £ u ' n converges absolutely. 

In rearranging an absolutely convergent series, we may separate its 
terms into a finite number, q , of infinite sets, and use each set to form a 
new infinite series. We may then sum each of these q series and add the 
q 6ums. Let the separate series be Z^in> lL u 2 n, * * *, J^u qn . 

If £ W = S, (115) 

n=*l 

we have: Z) K'„| ^ Z) |w»| S S, (116) 

n=l n*1 

so that each of the separate series converges absolutely. Now select an 
N such that the relation (111) holds, and take any tii > N, and n 2 so 
large that all the first n\ terms of the original series are included in the 
sums to n 2 terms of the q series. .Then we have: 

£ £< n - am 

r»l n*l n*»l k 

where Uj k denotes a term with subscript greater than n x . If the largest 
of these subscripts is n x + p 2 , we have: 

Z! Wjk\ =2 £ \ u n x +mV 

k m=l 


(118) 
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Since n 2 becomes infinite when Mi does, this proves that: 

W B . (119) 

r*l n«l n» 1 

In place of a finite number of sets, we may use an enumerably infinite 
number of sets. Each set may be arranged in an infinite series, and the 
sums of these series taken as the terms of a new series. As before, we 
may show that each separate series converges absolutely. We select N 
and ni > N as before, and then take n 2 sufficiently large and a suffi¬ 
ciently large number of the sets, q } so that all the first n\ terms of the 
original series are included in the first n 2 terms of the first q series. We 
again have the relations (117) and (118). Thus the left member of the 
relation (117) is at most e for all sufficiently large n ly and we must have: 

£ £ Wn - £ u n < €, (120) 

r = l 1 n = l 

for sufficiently large q. 

This proves that the infinite series whose terms are the sums of the 
separate series converges to the same sum as the original series. 

Conversely, a multiple series, or series of series, may be rearranged as 
a single series which has the same sum, if the single series is absolutely 
convergent. 

203. Operations on Series. Two convergent series may be added 


termwise, since if w n = 

u n + v n , then 



V P P 

£ W n = jC U n + Z V n} 
n=»l n = l n = 1 

(121) 

so that 

00 ao 00 

22 u>„ = 22 u n + 22 v n - 

n=* 1 n®=l n = 1 

(122) 

The same is true of any finite number of series. 

For the product of two convergent series, we have 


LiH 

£d = lim|£ u m \\ £ v m \ 

Ln = l n—► x Lr» = l J Ltn = 1 J 

(123) 

-si 

n n n~ 1 n—1 “1 

2Lu m 22v m - • 

_ rn~l m*» 1 m®*! m =» 1 J 

(124) 


For n = 1, the sums from 1 to 0 are to be replaced by 0. 

Suppose that both series are absolutely convergent. Then if 

f £ W = 5 and £ \v n \ - T, (125) 

* n«*1 n»l 

£ kmi £ Kl £ ST. 

m«l n«*l 


( 126 ) 
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Thus any arrangement of the double series with general term \u m v n \ as a 
single series will have a bounded sum and hence converge. Hence the 
corresponding series with absolute value signs omitted will converge 
absolutely, and all rearrangements of 2* 'jL,u m v n will converge to the 
same sum. Since one arrangement has a sequence of partial sums equal 

to 22 u m \\ 22 Vm , it follows from the relation (123) that: 

Lm»l J Lm=l J 

t o° ir 00 *i °° °° 

Z «» II I Vn = Z Z UmVn, (127) 

71=1 J Ln = l _J m — l n=1 

when the two original series converge absolutely. The double series on 
the right may be rearranged in any way without altering the sum. The 
most useful arrangement generally is: 

U\V\ + (u\V2 + U2V 1 ) + (U1V3 + U2V2 + ^ 3 ^ 1 ) + • * * , ( 128 ) 


where the sum of the subscripts in the nth parenthesis is n + 1. 

204. Practical Tests. The tests for divergence of positive series 
which show that u n cannot approach the limit zero may be applied to 
u n . Thus, 


if 


lim 


u n - f-i 

U n 


> 1, 


or lim y/\u,\ > 1, 


(129) 


the series u n diverges. 

Absolute convergence is usually proved either by applying the pro¬ 
cedure of section 195 to the series ]£ \u n \, or by a comparison with a posi¬ 
tive series known to be convergent. In this case we deduce the absolute 
convergence of 2 «u n from the convergence of and the relation 

\Un | ssS Pn* 

206. Infinite Products. An infinite product is an expression of the 
form: 

(1 -f- iq)(l 4“ U 2 ) • • • (1 + u n ) • • * (1^0) 

By a real infinite product we mean one for which all the u n are real. We 
shall consider only products with no zero factors, so that 

Uk J* —1. (131) 

Analogous to the partial sums of a series, we may form partial 
products 

P n — II (1 + Uk) = (1 + wi)(l + U 2 ) (1 + ^ 3 ) •••(!+ u n ). (132) 

1 


lim P n = Pj 

n—►« 


if 


(133) 
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where P is finite and different from zero, we say that the infinite product 
is convergent, and converges to the value P. We write in this case 

II (1 + «») = P or simply 11(1 + u„) = P. (134) 
»«*1 

We sometimes use 11(1 + u n ) as an abbreviation for the expression 
(J30) when the initial value is clear from the context. When P n either 
does not approach a limit or approaches a limit zero, we say that the 
infinite product diverges. A real divergent infinite product may either 
diverge to zero, diverge to infinity, or oscillate. Compare the remarks 
on the behavior of real series in section 186. 

If a finite number of Uk, all preceding the JVth factor, are allowed to be 

— 1, the terms convergent and divergent may be applied to the original 
00 

product to mean that H (1 + u n ) converges or diverges in the sense 

n«JV 

just defined. Thjs extension enables us to multiply in or divide out, or 
change a finite number of factors, zero or not, at the beginning of a 
product, without affecting its convergence or divergence. 

206. The General Condition. A necessary and sufficient condition 

00 

for the convergence of the infinite product II (1 + u n ), u n ^ —1, is that , 

n = 1 

for any positive number e, there is a number N ey such that , for any n > N t 
and all positive integers p y 

ft (1 + Wn+Jfc) ~ 1 < €. (135) 

X 

To prove the necessity of the condition, let us suppose that the infinite 
product converges. Since P, the limit of P ny is not zero, we may select a 
positive number tj, with 

0<,<?. (136) 

We next select a number N such that, for n > N, 

\P n — P| < ij, or P n = P + 8v, with \B\ < 1. (137) 

We will then have: 

ft (l + to - |P.|S|P|-|P„-P| (138) 

Also; if « > N; n + p > N, and 

Pn+r - P - W\ < 1. 



(139) 
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n+p 

p H (1 "I" W m ) p 

n a + u n+h ) - i = ==i - 1 = 

n a +«») Pn 

m = 1 

_ P djn _ . _ (o' — flb; 
P + dr, ~ - P + fr, ' 

Consequently, we have for the absolute value: 

h (i + u n+k ) -1 ^ j-j ^ j^-■ 


Since the only condition imposed on tj was the relation (136), we may 
so choose rj that the last expression is less than any given t. In fact, 

i^<< * ”< M r- < 142 > 

This proves that the condition is necessary. 

We will next prove the sufficiency of the condition. Accordingly, we 
assume that the condition is satisfied. Then, for any given positive c, 
we shall have : 


fl (1 + ^n+fc) ““ 1 < C, 


A (1 + u n+ k) = 1 + 6e, |0| < 1, for n 5; N,. (144) 

*«1 

We let N denote N t for e = 1/2, and only consider values of c g 1/2. 
We also take N e > N. 

Again, we have: 

if (i+ um) - n a+ u m ) - n a +««) [ ft (i+«»+*) -1] (1 45 ) 

m»l m«=l m = 1 «J 

But, from equation (144) with e = 1/2, 


^te-4(i + w+ ,)-i + 5. 

Pn t -1 z 


Consequently, 


i < < 2 , and \P N+P \ < 2|P*|. (147) 



322 


INFINITE SERIES AND INFINITE PRODUCTS [Chap. IX 


Let us put 

M = \P N \. (148) 

Then any n> N may be used as N + p, so that: 

^■<\P n \<2M, if n>N. (149) 

z 

For any n > N €f n > N t > N, so that the relations (143) and (149) 
both hold. From these and the identity (145) we may deduce: 

|Pn+p — P n \ < 2Mc, if n > N t . (150) 

Since M is fixed, and e arbitrary, it follows from this last relation that 
forn —» oo, P n approaches a limit by the Cauchy convergence criterion. 

Also, since no single factor is zero, M is not zero, and from the relation 
(149), the limit has a numerical value at least M/2, and so is different 
from zero. 

Thus, if the condition is satisfied, the infinite product converges. 

As a consequence of the necessity of the condition, we note that, for 
V •* 1> 

|(1 + u n+ 1 ) - 1| < 6, or \un+i\ < e, for n > N e . (151) 

This proves that a necessary condition for the convergence of an infinite 
product is that lim u n = 0. This condition is the reason for writing the 

n-*-x> 

factors as 1 + u n . 

207. Absolute Convergence. The expression 

ft (1 + u n+k ) - 1, (152) 

which occurs in the condition for convergence, when multiplied out and 
the — 1 cancelled becomes a polynomial in the u n +k with positive coeffi¬ 
cients. Consequently, 

ft (1 + «»+*) - 1 £ li (1 + \u n +k\) - 1. (153) 

A=*l & = 1 

It follows from this, and the condition of the preceding section, that if 
H(1 + |u„|) converges, then 11(1 + «n) converges. Under these 
conditions, the latter product is said to converge absolutely. The abso- 
hiteiionvergence of any infinite product depends on the convergence of a 
positive product, that is one all of whose factors may be written 1 + p n , 
where the p» are positive or zero. Accordingly, we consider such posi¬ 
tive products. 
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We begin by applying the law of the mean to e*, x 2: 0, and so obtain: 
e x — e° 


= J> x 


x — 0 


e ^ 1, or e* ^ 1 + x, x 2; 0. 


(164) 


It follows from this that: 

l^n(l + p^e‘- lfi . ( 155 > 

k-l 

The product of the first n factors of a positive product is a monotoni- 
cally increasing function of n, and accordingly approaches a limit if it is 

oo 

bounded. If 2- Pk = then e* is an upper bound for all the partial 

n = l 

products, and these products approach a limit as n —» oo. Since the 
products are all at least unity, the limit is at least unity, and hence 
distinct from zero. Thus the infinite product converges. 

Conversely, if the infinite product converges, so does the series 
For we have: 

i + ivk^ n a + p k ), (i 56 ) 

k=i 


since the right member, when multiplied out, includes the terms on the 
left, as well as other additional terms which are positive or zero. This 
shows that if the product converges, its limit less unity is greater than or 
equal to any partial sum of the series 'Epic- Thus these partial sums 
are bounded, and, since the series is a positive series, it converges. 

We have thus proved: 

A necessary and sufficient condition for the convergence of a positive infinite 
product 11(1 + p n ), is that the positive infinite series £ p n converges . 

If we consider the p n as u ny we may conclude from this that: 

^4 necessary and s'uffident condition for the absolute convergence of the 
infinite product na + u n ) is the absolute convergence of the infinite series 

208. Rearrangement of the Factors. If an infinite product converges 
absolutely, and we rearrange the factors in any way that neither omits 
any, nor adds any factors, the new product will converge absolutely, by 
the properties of series and the theorem just proved. Let P n be the 
partial product to n factors of the original product, with factors (1 + w n ), 
approaching a limit P. Denote by P f m the partial product to m factors 
of the rearranged product, with factors (1 + u r n ) } approaching a limit 
P\ By the general condition of section 206, applied to the positive 



m 
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product 'with factors (1 + |w„|), there is an N such that 

fi (1 + |«n+kl) ~ 1 < e, for n > N ( . (157) 

Now take ft ^ u form F„ , a n d then take wi so large that all the factors 
of P» are included in Then we have: 

5 s -1 = na + u jk ) -1, (i 58 ) 

r n k 

where all the u& have subscripts exceeding n. 

From the relation (153) it follows that: 

n(i + u jk ) -1 g na + m) -1. aso) 

k k 

Since each factor (1 + |w#|) is at least unity, if we add additional factors 
to the product in the right member, this member will be increased, or at 
least not diminish. Thus, for a suitable positive integer p, 

na + u jk ) -1 s fi a + |m„ + *d -1, (leo) 

k k** 1 

p' 

and — 1 < e. (161) 

n 


Since m —» 
that 


oo when n —* qo , and P ^ 0, we may conclude from this 


p> pr 

- - 1 < e, or --1 = 0, (162) 


since t is arbitrary. Thus P' = P, and we have proved that: 

If the factors of an absolutely convergent infinite product are rearranged 
to give a new product, the new product is also absolutely convergent, and 
has the same valve as the original product. 


209. Products of Fixed Sign. If the u„ are all real and negative, we 
may write the typical factor as (1 — p„). If the p„ are all less than 
unity, we have: 

(1 - p*)(l + p n ) - 1 - vl < 1. (163) 



Thus 


(165) 
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If the series diverges, it follows from the relation (156) that the 
product 11(1 + Vk ) diverges to + a > t and from the relation (165) that 
the product 11(1 — p^) diverges to zero. On the other hand, if the 
series converges, then the product 11(1 — pt) converges abso¬ 
lutely. Since the infinite product 11(1 + u n ) as well as the series ]£«» 
can only converge if lim u n = 0, the condition that p n is less than 

n— 

unity will always hold from a certain factor on, if we have convergence. 
Thus we may combine the result just found with that for positive prod¬ 
ucts in the theorem: 

If, for all sufficiently large n, the u n are real and of fixed sign, the infinite 
product na + u n ) will converge if and only if the infinite series X/u n 
converges . 

That the condition of fixed sign is essential may be seen from the 
example: 


1 1 1 

u i “ ~ ^ ’ ^2 ^ ~ ’ U2n ~3 


~T ’ ^2n-2 — ~T H-* (166) 

ri$ 7i* n 


The infinite product 11(1 + u n ) converges. For the individual factors 
approach unity, and when grouped in pairs we have: 

(1 + u 2n ^)( 1 + u 2n ^ 2 ) = 1 - (167) 

71 * 


which is the factor of an absolutely convergent infinite product. How- 

n+l 

ever, the series diverges, since its 27ith partial sum is X) 1/&. 

k-2 


EXERCISES IX 


1. If £p n is any convergent positive series, a second such series Zp'n can 
be found with lim p' n /pn = 00 . Hint: We may put r 0 = s,r n = s — s n , and 


>/r n . Then s' n — Vs 


V - Pn 

s. And 

Pn 


r n -i r n 


V'V,,, so that the primed series con- 
= Vr„_i + Vu —► 0. 


/ r^Ii - Vr„ 

2. If p n is any divergent positive series, a second such se ries c an be found 
with lim p n lp H * 0. Hint: We may put p’„ = W n — Vs n _i, p[ = Vpi. 

, j Pn 1 „ 

+ «, and — =-= ——> 0. 

pn “ $n-l V S n + VS n -1 

3. If the terms of a positive convergent series monotonically decrease as n 
increases, then p n - o(l jn). Hint: The sum of the terms from that with index 
7 i /2 to n exceeds (n/2)p n , so that if |$ — $ n | < *, when n > N, np n < 2« 
when n > 2N. 


Then s' n = W 
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4. The condition of problem 3 cannot be improved, since if /(m) is any 
positive function such that /(to) -> 0 as m », we may find a positive con¬ 
vergent series whose terms monotonically decrease, with p n ** /(to) /to for an 
jofuate number of values of m. Hint: Select a series of values of to, to*, for 
which firm) < 1 /2*, take /(to*) /to* as the (»u)th term, and all terms after the 
(m* — l)st which precede this. Then the series converges, since the sum to 
* 

m* terms is less than £ /(m*) < 1. 

fi. Rummer’s Criterion. Let o„ be any sequence of positive numbers, and 


Pli 

m the terms of ft positive series. Form the expressions a*-a«+i * K n . 

Pn+l 

The series p n converges if iim K n > 0, so that for sufficiently large n the K n 
exceed some fixed positive number. Hint: With a change in the notation, if 
necessary, we may assume K n > A, for all n. Then a n pn Gk-fipn-fi ^ Ap nt 
and summing aipi — an+iPn+i > ALPn, so that 2 2pn bounded. 

6. If the positive numbers a„ of problem 5 are such that ^l/a* diverges, 

and Urn K n < 0, or even K n g0 for sufficiently large n, the series 2>n diverges. 
Hint: Use the test IV' of section 191, with £l /a* as the comparison series. 


7 . 


Prove that the positive series jLp n converges if logn 



has lim > 1 , and the series diverges if the expression has lim < 1 . Hint: Put 
&n ^ n logn, and use problems 5, 6 and equation (52) of the text. 

& Deduce the rule of section 194, equation (55) from the preceding problem . 


9 . Prove that the expression F(n) 


i + - + - + 
2 3 


■ + 


log n is 


always positive, and decreases with n, so that it approaches a limit as n —> oo. 
The limit is known as Euler's constant, and is denoted by y, so that 
lim F(n) = y. In section 323 we shall show how to compute its value, 


0.5772157 * * •. Hint: With f(x) — 1 jx, we have from equation (30) 

log » £ 1 +“ + ••• H-- > so that F(n ) is positive. And from equation 

2 n — 1 

(20), 1/n logn ~ log (n - 1), so that F(n) - F(n — 1) 0, so that F(n) 

decreases with n. 


10* Prove that 1 — ^ + i — ••• = log2. 
2 3 


Hint: If s n is the sum to n terms 


of /n, s» = y + log n + o(I), by problem 9. For the series of this problem, 

the sum of 2» terms is 8% n — 2 (?) = y + log (2n) - (y + log n ) + o(l) = 

log 2 + o(l). The odd sums also approach log 2, since the separate terms 
approach zero. 

11. Prove that if we rearrange the terms of the series in problem 10, taking 
alternately blocks of p positive terms and q negative terms in order, the sum of 
the series is log (2p lli /q l/i ). Hint: As in the preceding problem, the sum of the 
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Smq 

2 


7 + log 2mp — 


first 2m(p + q) terms may be written as « 2mp - 

1 /2 (t + log mp) — 1 /2(y + log mq) + o(l) *= log 2 + 1 /2 log (p jq) + o(l). 
'The other sums approach the same limit, since the sum of any group of 2 (p + q) 

or fewer terms from ]j£l /n, all beyond the Nth is at most which —> 0 

when N—> qo . 

12. Prove that the positive series converges if and only if r < 1 by using 
the integral test of section 192. 


13. If we start with n = 2 , the series with u n = —--— has all its terms 

n (log n) a 

positive. It converges if a > 1 , and diverges if a £ 1 . Prove a similar result 
when the denominator is n (log n)(log 2 n) • • • (log r n) a , where log 2 n means log 
log ft, and similarly for log r n. We must start with a large enough value to 
make all the numbers whose logarithms are taken greater than unity, and the 
condition for convergence is always a ^ 1 . Hint: Use the integral test, and 
observe that 


A 

dx 


(log r x) = 


_ 1 _ 

x (log x) (log 2 x) • • • (log r_l x) * 


14. The series £ ■ 


■ diverges by problem 13, or section 194. Show that 


ft log ft 

for this series p n ~ o(l jn). This proves that the condition of problem 3 is only 
necessary and not sufficient for convergence. 

16. Show that the series x n jn n is absolutely convergent for all values of x, 
and that the same result holds for 2 f 2 ( 7 i)x n /n n , where R(n) is any rational 
function of n . 

16. Show that ]£R(n)x n jn ! is absolutely convergent for all values of x, where 


fl(n) is any rational function. 


An example is the series 1 + x + — + 

A 1 


x 

-f —- 4~ ... f which equals e x for real values of x, by problem 26 of Exercises IV. 

ft ! 

17. Show that £w w x n diverges for all values of x except x= 0, and extend the 
result to £fl(ft)ft n x n , where R(n) is any rational function not identically zero. 

18. Show that '£ t R(n)n ! x n diverges for all values of x except x = 0, where 
jR(n) is any rational function not identically zero. Hint: Use problem 19 of 
Exercises III. 

19. If R(n) is any rational function, show that J^R(n)x n converges absolutely 

if |x| < 1. Also that it converges for |x| = 1 if the degree of the denominator 
exceeds that of the numerator by at least two. It diverges for |x| > 1, if R(n) 
is not identically zero. _ 

20. The series with Un^l/n diverges, while that with * ( —l) n (l /Vn) con¬ 
verges. But |Un) S |%nl» This illustrates that no comparison test holds for 
non-positive series. 
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21. The series with «i = 1, «2 = — x and 

ca 

o(a + l)(a + 2) • • • (a + n - 1)6(6 + 1)(6 + 2) • • • (6 + n - 1) 

Un = c(c + l)(c + 2) • • • (c + n - 1 )d(d + 1 )(d + 2) • • • (d + n - 1) *" 


is known as the hyper-geometric series. If no factor (a + n ), (b + n), (c + n) or 
{A + n) is zero, prove that it converges absolutely if \x\ < 1, and diverges if 
\x\ > 1. 

22. If the test-ratio of a series of complex terms has the form = 1 + — 

Un n 


+ 




prove that the series is absolutely convergent if R(A) < — 1. Apply 


this to show that the hyper-geometric series of problem 21 is absolutely con¬ 
vergent for x * 1, if R(a + 6 — c — d + 1)<0. 

23. If the Pn are a sequence of positive quantities which monotonically 
decrease to zero, sin n$ converges, and if 6 ^ 0, cos nd converges. 
Hint: They are the real and imaginary component series of and the 

sums of the geometric series £(e^) n have |s„| = |1 — c t(n+1) *|/|l — ^ 

2/(1 — cos 0), and so are bounded. 


24. The infinite product II £l — ~ + 0 diverges to 0 if b > 0, and 

>f n factors 

•(*)>■ 


diverges to +°° if b < 0. Also, for sufficiently large n, the product of n factors 

f b 

is a monotonic function of n. Deduce that if Un+i /u n = 1 

diverges if b < 0, and converges if b > 0 and 6^0. Hint * Use section 
209, and the preceding problem. 

26. The binomial series is 


~ + 0 
n 


1 + mx *+ 


m(m — 1) 
2 ~! 


** + • * * + 


mini — 1 )(m — 2) • • • (m — n + 1) 


x n + • 


It follows from problem 29 of Exercises IV that it represents (1 + x) m for m real 
and x real and — 1 < x < 1. Prove that for m real but x complex, the series 
converges absolutely if \x\ < 1, and diverges if \x\ > 1. Also, that for |x| = 1, 
it diverges if m £ — 1 and converges if m ^ 0. For — 1 < m < 0, it converges 
for |x| = 1, if x 5 ^ — 1, and diverges if x = — 1. Hint: Use the preceding prob¬ 
lem and section 196. 

26. If m(x) is a monotonic function of x, and f(x) is bounded and integrable 
for a ^ sjg h f prove that there is a value £ such that 


Lii. 


1 j* f(x ) m(x) dx = m(a) J* f(x) dx + m(b) J* /(x) dx. 


m(x) is increasing, interchange a and b. If ra(x) is decreasing, put 
p(x) — m(b) and apply the Bonnet mean value theorem. 
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27. If we put go — 0, Qk — Sk , fo = 0, /* =* p* and 8gu = s* — = w*, 

5/* = pit — pjk-i, the Abel identity (71) may be written: 

n n 

iC /& ^9k = /n0n — /<)0O ““ £) 1 

A*=l 


which is similar to equation (44) of section 165 and shows the relation of the Abel 
identity to the formula for integration by parts. 

28. Complete the details of the following proof of the Bonnet mean value 
theorem for the restricted case of f(x) continuous, and p(x) having a continuous 
derivative p'(x). Here we may assume p(b) ^ 0 and p'(x) g 0, instead of p(x) 

positive and monotonically decreasing. If F(x) = f f(u) du, 


J f*b pb 

f(x)p(x) dx = / F'(x)p(x) dx = 

a «/ a 


F{b)p(b) - f F(x)p’{x) dx 


= F(b)p(b) - F(?)[p(b) - p(a)], 


by equation (52) section 125. If this equals Fp(a), by problem 1 of Exercises V, 
F divides F(b) and F{£') in the ratio of p(a) — p(b) to p(b), which is positive. 
Hence F lies between F(b) and F(£'), and so is assumed at some point £. Thus 

f f(x)p(x) dx = Fp(a) = p(a)F(£) = p(a) f f(x) dx. 

t/ a v a 


29. Prove that if p(x) is positive and monotonically decreasing for x ?£ a, 
and p(x) —>0 as x —> +oo, while for some fixed number M and all values of 

I pX p<X> 

I f(u) du ^ M, then I p(x)f(x) dx converges. An example is 

va t/ a 

ELlfc' Hint; Deduce f f(x) dx = f f(x) dx — f f{x) dx g 2M y 

a X I m | 1 a ** a 

I pm' I I pm ' I 

I P(x)f(x) dx S J p(w) / f(x) dx \ ^ 2Mp(m). 
J m J j v m I 

Then use the Cauchy convergence criterion. 

30. If a is any complex number 0, show that the infinite product 
na -f x n /a n ) converges if |x| < \a\, and diverges if \x\ > |a|. 

31. Show that, for any real x , each of the infinite products: 

0 - »)<1 + ») (l - |) (* + 1) (l - l) (‘ + 1) " ' 

E(1 - Z)‘*] E(1 + z)e~*] ^1 - 0e a J j^l + • -, and Jl ^1 - 


converges to the same function of x , the first conditionally and the other two 

absolutely, if we regard [(1 =F x/n)e ±xln ] as a single factor of the second. In 

sin to: *r« bi¬ 
section 285 we shall show that the common limit is-. Hint: For the 

irx 

second, from e u « 1 + u + 0 (u 2 ), deduce that for any fixed real x the typical 
factor is 1 + 0 (l/n 2 ). 
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82. Show that if the factors of the first product of problem 31 are rearranged, 

in the following manner: (1 + x)^l +^(1 —*)^1+|^1 • • •, 

the new product will converge, and its limit will be 2* times that of the original 
product. Hint: Let L(x) be the limit of the first product in problem 31, and 
hence of the second product of that problem, with the factors taken in any 
order. Then for the product of this problem to 3n factors we may write: 

where L n (x) = [(1 + x)e~ x ] J^l + 2 J [(1 - x)e] ■ ■ ■ 

K 1 + [(' - S) e "] • 

With the notation of problem 10, the sum multiplying x in the exponent 
is — $n> and so has log 2 as its limit by problem 10. Hence, when the factors 
are taken by threes, the limit is log 2 L(x) — 2 x L(x). The product always con¬ 
verges to this limit, since the product of three or fewer consecutive factors 
approaches 1 as we go out in the product. 

\qn 


33. Prove that the infinite product 
verges absolutely if |x| < e 9 , and diverges if \x 


n[l~(l~n) * q > 0 con- 


> <*. 
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PARTIAL DIFFERENTIATION 

The application of the process of differentiation to functions of a single 
variable obtained from functions of several variables by keeping all 
except one of these fixed, leads to the notion of a partial derivative. 
After defining partial derivatives and studying their fundamental 
properties, we discuss certain results on implicit functions and functional 
dependence related to the expressions known as Jacobians. 

210. Partial Derivative. If f(x,y) is a function of the two real 
variables x amd y, for each particular value of y it defines a function of x 
to which we may apply the process of differentiation: 

f(x + h,y) — f(x,y) 

lim --- (1) 

h -+0 fl 

If this limit exists for a particular value of x, it defines the derivative of 
f(x,y) with respect to x , for the particular values of x and y considered. 
To emphasize that x is not the only variable, we call the limit the partial 
derivative of /(x,y) with respect to x, and denote it by 


T or f x (x,y). 
ox 

(2) 

211. Total Differential. When y is kept constant, 
to an increment Ax, we have a partial differential, 

and x is subjected 

< 

*i. 

ii 

5 

(3) 

dx 

Similarly, if y is subjected to an increment Ay, 


e 

H 

(4) 

The sum of these two partial differentials, 


df df 

df-dJ+dJ^-^Ax + ^Ay, 

(5) 


is the total differential of /. 

We may write 

4f * (V + <*[|Ax| + |Ay|], 
331 


(6) 



PARTIAL DIFFERENTIATION 


[Chap. X 


where a is determined by this equation. If, when Ax and Ay both 
approach zero, a approaches zero, the function f(x,y) is said to be 
differentiable in x and y. 

We shall now prove that: 

If both partial derivatives of f(x,y), df/dx and df/dy, are continuous 
in Hie two variables x and y at (xo,2/o), then the function f(x,y) is 
differentiable for these values. 

We have, for h and k sufficiently small, 

A/ = /(x + h,y + k) — f(x,y) 

= f(x + h, y + k) - f(x, y + k)+ f(x, y + k) - f(x,y) (7) 

= hf x (x + dih, y + k) + kf u (x, y + d 2 k), (8) 

by the law of finite increments for functions of one variable, since the 
assumption that the partial derivatives are continuous at a point implies 
that these derivatives exist in some two-dimensional region including the 
point in its interior. 

Moreover, if we write: 

f x (x + 0i h, y + k) = f x (x,y) + e u (9) 

and 

f y (x, y + 0 2 k) = f v (x,y) + e 2 , (10) 

it follows from the assumed continuity that ei —» 0 and e 2 —* 0, when 
h —* 0 and k —»0. But, from equation (5) and the last three equations, 
if h = Ax and k = Ay we have: 


Af = A x[f x (x,y) + «i] + Ay[f v (x,y) + t 2 ] 

= df + «i Ax + t 2 Ay. 

A comparison of this with equation (6) shows that 

, , M + fgfcj < kj \h\ M M < i i , | , 
|a| |A| + |*| - |A| + \k\ + \h\ + \k\ - |ei1 + |£z| - 


( 11 ) 

( 12 ) 

(13) 


This shows that a —> 0 when h and k, or Ax and Ay —* 0, which proves 
the theorem. 

We might have deduced that 

f(x, y + k)- f(x,y) = kf y (x,y) + e 2 , (14) 


where eg -*♦© when h—>0, from the mere existence of the partial deriva¬ 
tive 3//#, Or f v (x,y) at the point. Since this could have been used to 
transform the last two terms of equation (7) into the terms of equation 
(11) involving Ay, it was unnecessary to assume the continuity of 
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fy( x >V )• It follows that it is sufficient for the differentiability of f($,y) 
to have both partial derivatives exist at a point, and one of them be 
continuous there. 

We also note that, if the function f(x,y) is differentiable, so that the 
relation (6) holds with a —»0, the relation (12) may be written with 
hi — hi — hi- Since these values of e x and €2 approach zero with a, 
they each approach zero with Ax and A y. Thus relation (12), with e x 
and e 2 each approaching zero when Ax and Ay both approach zero, is a 
consequence of the condition that f(x,y) be differentiable. Such a 
relation is an alternative condition for differentiability, since by the 
relation (13) differentiability may be deduced from it. 

212. Composite Functions. If x and y are each functions of a third 
real variable t , we have: 


Af 

At 


df 

At 


+ €l 


Ax 

~At 



(15) 


as a consequence of equation (12). If the functions x(t) and y(t) each 
have finite derivatives with respect to t: 


dx .. Ax dy Ay 

— = lim — > — = lim — ; 

dt At dt At —►o At 


(16) 


and when At —► 0, Ax and Ay will also approach zero. Thus, in equation 
(12), or (15) €1 and «2 will approach zero. It follows that: 


— -lim—- — — + — — 
dt im At dx dt dy dt 

Also, for the differential as defined in section 70, 


(17) 


<V = 



= T dx + T dy - (18) 

dx dy 

This shows that, if x and y are each differentiable functions of t, and 
f(x,y) is a differentiable function of x and y, the differential of/, when f is 
the independent variable, has the same form as the total differential 
when x and y are the independent variables. 

If * and y are each functions of two real variables, s and t, and we keep 
s constant, the same reasoning shows that 

df df dx df dy 
dt ~ dx dt dv dt 


(19) 
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tn this equation, for the t derivatives, s is constant; for the x derivative, 
y; and for the y derivative, x is constant. When this may lead to con¬ 
fusion, we indicate the variable held fast by & subscript, and write the 
last equation as: 



213. Higher Derivatives. We may form partial derivatives of par¬ 
tial derivatives, as 


d 2 f 

,(x,y) - ^2 


±($), 
dx \dx/ 


( 21 ) 


or 


fxy(x,y) — 


a 2 / 

dy dx 



( 22 ) 


We shall now prove that, if the first partial derivatives exist in some two 
dimensional region including (xo,y 0 ) and the derivative f xv ix,y) is con¬ 
tinuous at (xo,yo), then the derivative f yx ix 0 ,y 0 ) exists, and f yx (xo,yo) = 
/»»(*b,lto). 

We use A as an abbreviation for the mixed second difference, so that: 


A «■ f(x + h, y + k) — f(x + h, y) - fix, y + k) + f(x,y). (23) 


Then, if we write 

Fix) = f{x, y + k) - fix,y), (24) 

A - F{x + h) - F{x). (25) 

From the law of finite increments, we have: 

A - Fix + h) - Fix) - hF'ix + Oh) 

= h[f x ix + 6h,y + k) - f x ix + Oh, y)) 

= hkfxyix + eh, y + e'k). (26) 

Hence we have: 

A /(* + Ji, f + k) - fix + h, y) fix, y + k)- /(x,y) 

— *St " ■ ■ - - - - - —- — — — 

k k k 

” hfxtiiz + eh, y + e'k). (27) 

Let t and y be the io,l/o of the theorem, and take the limit aa k -* 0. 


Then for a sufficiently small h the first partial derivatives exist and we 
have: 

fyix + h, y) — /„(*, y) « h lim /, v (x + 6h,y + e'k). (28) 

k-+0 
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Next divide by h, and take the limit as h —► 0. Recalling that fsy(x,y) 
is continuous at the point considered, we have 

lim lim f xy (x + Oh, y + d'k ) = f xv (x,y). (29) 


This shows that the limit of the left member of equation (28) divided 
by h , exists, and 


fyx(x } y) 


= jjjh fjM + h,y) - f v (x,y) 
h—+0 h 


fx V (x,y ), 


(30) 


which is the conclusion of the theorem. 

It follows from the theorem that, in any higher derivative, say of the 
nth order, we need not distinguish between the orders in which the vari¬ 
ables are taken, provided that all the derivatives of order equal to or less 
than n exist and are continuous. Thus, with this continuity assumption, 

a 3 / _ a 3 / * 3 / , (u) 

dx dy 2 dy dx dy dy 2 dx 


j!L(v\ = a 2 /an 

dx dy \dyj dy dx \dy/ 


(32) 


and 



( a 2 / \ 

-!( 

f d 2 f \ 

dy' 

\dx dy) 

dy ' 

\dy dx) 


(33) 


214. Functions of n Variables. If f(x it x 2 , • • • , x n ) is a function of 
n variables, the partial derivative df/dxi is defined as the derivative 
taken with respect to Xi when the remaining variables are held fast. The 
total differential is 


df = 



AX{ 


n df 

= X—dxi, 

«•-1 dX { 


(34) 


and as for two variables, we find that 

A f = df + A Xi, (35) 


or 


n 


Af - df + «Z |Ax,-|, 

»-i 


(36) 


where the «,• and a approach zero with all the Ax,-, if all the partial deriva¬ 
tives are continuous at the point considered. 

From the relation (35) we may deduce that, if the x, are each differen¬ 
tiable functions of m variables y,, then 

6f » df dxi 
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Also, the relation 

n df 

»-l OXi 


(38) 


holds whether the Xi are regarded as independent variables, or dependent 
on the new set of variables yj. For, if the x t - are functions of i/j, we have 
for the total differential expression: 


since 


<V . " df - dxi 

df=Ji — dxi= It- I" dy } , 
<» 1 OXi t«i dXi y-1 oyj 


(39) 


dx,- 


r— 

y=i dyj 


dyj. 


(40) 


A comparison of equation (39) with equation (37) shows that 

m df 

df^Zr-dyj, (41) 

j-i d Vj 


which has the same form as equation (38), and so is valid when the y, 
are the independent variables. 

216. The Mean Value Theorem. If we abbreviate the function of 
m variables f(xi, x 2 , • • •, x m ) by /(x,-), and write 

Xi — a,i + thi, (42) 

we have: 

f(xi) = /(a,- + thi ) = F(t), (43) 


a function of the single variable t. 

Also 

/(<*<) = F(0) and /(a,- + ft,) = F(l). 

By the law of finite increments for functions of one variable, 
F(l) - F(0) = F'{6), 0 < 6 < 1. 

And, from equation (37), we have: 

dt j=l dx,j 


(44) 

(45) 

(46) 


Hence we may conclude that: 

/(a* + hi) - f(di ) 


£ df_ 

i'-i dXj 




(47) 


where the partial derivatives with strokes are to be evaluated at the 
point: 


Xi = o,- + 0h%. 


( 48 ) 
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If we put 

II 

V 

■s 

o3 

•*» 

II 

H 

&i “1“ hi , 

(49) 

we may write the relation in the form: 




/(*") - /(*,•) = 

; = 1 dXj 

(*" - Xj), 

(50) 

where the derivatives are to be evaluated at: 



Xi = x[ + 0(X-' - 

- x'), 

(51) 


that is, a suitable point on the straight line segment joining x[ and x[\ 
The equation holds if all the partial derivatives exist and are continuous 
for all values on this line segment. 

We may deduce from the mean value theorem that: 

A function of several variables , f{xi ), is constant in a connected region if 
all the partial derivatives df/dxi — 0 throughout the region. 

For, if the points can be joined by a straight line segment lying wholly 
in the region, the condition on the partial derivatives, combined with 
equation (50), shows that: 

/(*.") ~ fix') = 0, and /Or") = /(*'). (52) 

But, by the definition of a connected region, any two points of it can be 
joined by a broken line lying wholly inside the region. It follows from 
this that the function has the same value at any two points of the region 
and is therefore a constant. 

216. Taylor’s Theorem. With the notation of the last section, we 
may deduce Taylor’s theorem for the function of m variables /(x<) from 
that for the function of one variable, F(t). We have for Fit ): 

Fit) = F(0) + F'(0)t + F"(0) £.+••• + F (n \ 0) - + B(t), (53) 

2! n\ 


where R{t) has any of the forms given for R(h) in section 91. 
We find from equation (37) as in equation (46): 

f - ££»„ 

dt fZ i dxj 

and by repeated application of equation (37): 



(54) 


(55) 
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where the power is to be expanded by the multinomial theorem, and the 
terms finally reduced by such relations as: 




QP+9+rf 

1 dx? dx% dx\ ‘ 


(56) 


We may combine the equations (43), (53), and (55) to give Taylor’s 
theorem for n variables. The result is: 


'<*+«- + (I *4) jf+ si Cl * i) !/+ • ■ • 

+U& ‘ 4 )" /+B(1) - (67) 

If we use Lagrange’s form of the remainder, we have: 

1 / m d \ n+1 

C?/W * <58) 

where the derivatives are to be evaluated at the point 

x,- = o< + 0 < 0 < 1, (59) 

where 6 is a suitably chosen number between zero and one. 

217. Implicit Functions. In section 38 we formulated a theorem on 
the implicit function defined by the equation 

f(.V, x u x%, • • •, x k ) = f(y,Xi) = 0. (60) 

The theorem stated that, if / (y,Xi) is continuous in the fc + 1 variables 
in some fc + 1 dimensional region including yo,x 0 i in its interior, 
fiVo^oi) “ 0, and the function /(j/,x,) is an increasing (or decreasing) 
function of y, for Xi fixed and y,Xi in the region, then the equation (60) 
uniquely defines a continuous function: 

y = F(x i, % 2 t' • 4 x k ) = F(xi). (61) 

We may replace the condition that/(j/,x,) is an increasing (or decreas¬ 
ing) function of y by the condition that the partial derivative df/dy 
■ exists and is continuous and different from zero at the point yo,xoi. For, 
if the derivative is positive at the point, from the continuity it will be 
positive in some fc + 1 dimensional region including the point, and in 
this region/(y,x<) will be an increasing function of y, for x< fixed. Simi¬ 
larly, if the derivative is negative at the point, there is some fc + 1 
dimensional region in which /(y,x,) is a decreasing function of y, for x, 
fixed. 

If all the partial derivatives of /(y,x,) exist and are continuous at the 
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point (yo> x oi)> we may apply the mean value theorem, equation (47), 
to f(y,Xi) and obtain: 


f(y + A y, xt + Ax,) - f(y,Xi) = ^ 

dy\ 




Ax 


n 


i -1 dxf\ 

where the derivatives with strokes are to be evaluated at the point 


(62) 


y + 6 Ay, x { + 6 Ax,-, 


(63) 


for a suitably chosen value of 6 between 0 and 1. 

If y is related to the x, by the functional relation (61), the function 
f(y,Xi) is identically zero, so that the right member of equation (62) is 
zero. If we put all of the Ax, = 0, when iVl, and divide by Axi, 
we find: 


df 

dy 


*L + K. 

Axi dx\ 


= 0, or 


A y 
Ax i 


df_ 

dZ\ 

5 

dy 


(64) 


Since the function F(x,) is continuous, and we have put all the Ax< 
except Axi equal to zero, when Axi —> 0, Ay —> 0. Also the point at 
which the derivatives are to be evaluated, (63), approaches y,x,-. Hence, 
if df/dy is not zero at this point, and the partial derivatives df/dy and 
df/dxi are both continuous at this point, we may deduce from equation 
(64) that: 


JL 

dy ^ ^ Ay dxi 

dxi ah-*o Axi df_ 

dy 


(65) 


That is, if f{y,Xi) has continuous first partial derivatives at a point, 
and df/dy ^ 0 at the point, the equation 

f(y,Xi ) = 0 defines an implicit function y = F(x,-), (66) 


and this implicit function also has continuous first partial derivatives at 
the point, given by: 


df_ 

dy dxi 

dXi df_ 

dy 


For we may take any value of i in place of 1 in the discussion. 


(67) 
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If the function/(y,x,) has all its partial derivatives of the first n orders 
continuous, the same is true of the function F(x,), and the higher 
derivatives of this function may be calculated by repeated partial 
differentiation from the equation (67). 

It may be practically simpler to apply repeated differentiation to the 
relation / (y,Xi) = 0 on the assumption that y is a function of x,-, possess¬ 
ing continuous partial derivatives, and performing certain eliminations. 


218. Sets of Implicit Functions. Consider a set of n 
of » + k variables, 

functions, each 

f P (yi,xj) where p, i = 1, 2, • • •, n and j = 1, 2, 

05 

00 

Under certain conditions, the system of n equations 


fviVuXj) = 0, 

(69) 

implicitly determines a set of n functions, 


Vi = Fi(Xj). 

(70) 


To help us guess the form of one set of sufficient conditions, let us 
assume that each of the functions f p ( y^x ,) possesses first partial deriva¬ 
tives with respect to any of the n + k variables, and that each first 
derivative is continuous in the set of n + fc variables at a particular 
point (yi,Xj) = (yoi,x 0 j). This implies that the functions themselves 
are continuous, and in fact differentiable at this point. We also assume 
that 

f P (yoi,Xoj) ~ 0" (71) 

Further, let us temporarily assume that the system of equations (69) 
may be solved by a set of n functions Fi{xj) such that y 0 , = F,(x 0 >), 
and that these functions have first partial derivatives, with respect to 
each of the k variables xj, which are continuous in the set of k variables 
at the point (x 0j ). 

Then, at the point considered, by equation (37), we have: 

^E^^p+f^E^, (72) 

dxj dXj g.i dy t dxj 

where 

h(*i) = fvlFiixM (73) 

Since the implicit functions F,(x,) are solutions of the equations (69), 
the functions J p (xj) are identically zero, so that the left member of 
equation (72) is zero, and hence the right member is also zero. Conse¬ 
quently we have: 

f = _^E. 

a-i dy q dxj dxj 


(74) 
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For any fixed j, and p — 1,2, ,n, this system of n linear equations 

in the n partial derivatives dyjdxj may be solved for these quantities 
provided that the determinant of the system, 


dh 

dj\ 

dfi 

dyi 

dy 2 

dy n 

d/2 

d/2 

d/2 

dyi 

dy 2 

d?/n 

dfn 

dfn 


dyi 

dy 2 

dy n 


is not zero. 

The determinant (75) is called the Jacobian of the n functions f p 
with respect to the n variables We abbreviate it by 

J or ffl’-*’ - : H ’ (76) 

d(yl, 2/2, • • •, Vn) 

when we wish to indicate the functions and variables. 

When the Jacobian is not zero, the solution of the system of equation 
(74) for a particular derivative dy q /dxj may be written: 

d(/lj/2> * * ’ >fq, * ‘ * ) fn) 

fo/q = d(s/i,y 2 , • - ■ - # , 77) 

d%j d(/j, / 2 , ‘ ‘ , fn) 

d(yi, 2/2, * * * , 2/«) 

This calculation suggests the theorem: 

Let the n functions f v {yi,xf) each possess first partial derivatives with 
respect to the n variables yi and the k variables Xj, each derivative being con¬ 
tinuous in all n + k variables for a particular value yoi,%oj $u°h that 

f P (yoi,x 0 j) = 0. (78) 

Then } if the Jacobian is not zero, 

d(fl)f2) ' ' ' ) fn) A 


d(yi> 2 / 2 , * • * , Vn) 


5^ 0, at yoiyZoj, 


the n equations, 

fp(Vi) X j) = 0 , 

may be simultaneously satisfied by n functions, 

yi = Fi(xf), 


( 81 ) 
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such ihai 

Voi = Fi(Xoj). (82) 

These functions are uniquely defined and continuous in some k-dimen- 
sional region including Xq,- as an interior point, and in this region possess 
first partial derivatives with respect to the Xj, continuous in these k variables, 
determined by equations (74) or (77). 

We proceed to prove this theorem, using mathematical induction. 
We have already proved that the theorem is true for n = 1, and all 
values of k, in section 217. Thus we need merely show that the theorem 
is true for n and all values of fc if it is true for all smaller values, namely 
1, 2, • • • , n — 1 and all values of fc. 

Let us use C pq to denote the co-factor of the element of the determi¬ 
nant (75) in the pth row and gth column, or df p /9y g . Then, by expand¬ 
ing the determinant in terms of the elements of the last column, we have: 

(83) 


Since J is not zero at the point considered, not all of the C pn can be 
zero. By a change of notation, if necessary, we may arrange that 
C nn 0. We assume this done, and note that 


* * * y fn —l) 

d(Vl, V2, ■ • • , Vn-l) ’ 


(84) 


the Jacobian of the first n — 1 functions with respect to the first n — 1 
variables. 

We also recall the theorem that a determinant with two columns 
identical is zero, from which it follows that: 


p-i dy r 


0, r 


1 , 2 , 1 . 


(85) 


By the hypothesis of the induction, the theorem holds for n — I 
dependent variables and fc + 1 independent variables. Hence, if we 
consider only the first n — 1 equations 

= 0, s = 1, 2, • • •, n — 1, (86) 

and consider y T , r * 1, 2, • • •, n — 1 as the dependent variables and 
y n ,Xj as the fc + 1 dependent variables, we may deduce the existence of 
» - 1 functions F r (xj,y n ) such that 

Vor = $r(Xoj,yon), 


and furthermore if 


y T = F r (x jt y n ), 


(87) 

( 88 ) 
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o = —+ "r —— • 

dyn r-1 dy r dy n 
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(89) 

(90) 


Let us next use the equations (88) to eliminate the y T from the last 
function/„ (yi,Xj), and denote the resulting function by: 


fn (.VnjXj) fnffir(?Cj>yn)> lfn> *>]• 

Then we have: 

tin _ M? + 

fyn dy n r -i dy r dy n 


(91) 

(92) 


Let us now multiply each of the n — 1 equations (90) by C. n , with 
s corresponding to the equation used. Let us also multiply the equation 
(92) by C nn and add the corresponding members of the n equations just 
constructed. In view of equations (83) and (85) the result may be 
written: 

Cnn = J- (93) 

dy„ 

Since J 9 * 0, this shows that df n /dy n s* 0. Consequently, either by 
the hypothesis of the induction for one dependent variable, or the theo¬ 


rem of section 217, the equation 

/n (y n ,Xj) = 0 (94) 

uniquely determines a function 

Vn - F n (x,) (95) 

such that 

yon - F n (xoj) and /„[F„(*,), Xj] = 0. (96) 

Furthermore, the function F„(x } ) has continuous first partial derivatives. 
Finally we consider the n equations: 

Vr = F r (xj) = F r [x h Fn(xj)], and Vn = F„(z,). (97) 

From equations (87) and (96), we have: 

yog - F q (x 0 j), q * 1, 2, • • •, n. (98) 

And, from equations (89) and (96), we have: 

h(Vg> x i) = 0, if y q = F g (xj), p - 1, 2, • •, n. (99) 


Again, the functions F,{xj,y n ) and F n (xj) all possessed continuous 
first partial derivatives, so that the functions F q (xj) also possess con- 
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tinuous first partial derivatives. And, since F r {xj,y n ) and F n (xj) were 
uniquely determined, the functions F q (xj) are uniquely determined. 
Finally, the conditions assumed to derive equations (72) and (77) are 
satisfied, so that these equations follow. This completes the proof of 
the theorem. 

As in the case of one independent variable, if the functions f p (Xi,y,) 
possess continuous partial derivatives of the first n orders, the same is 
true of the F„(xj), since in this case the equation (77) may be differen¬ 
tiated m times, m i£ n, with respect to any combination of m of the Xj. 
The higher derivatives may also be obtained by differentiating the 
equations (99) suitably to obtain a series of equations, of which equa¬ 
tion (74) is the first, and by performing certain eliminations. In each 
case, the determinant of the system of equations in the derivatives of 
highest order reduces to the Jacobian which is distinct from zero by 
hypothesis. 

For example, if 

MVi, 2 / 2 , 2/3, Xu x 2 , x 3 ) = 0, and i = 1, 2, 3, (100) 


then, for s fixed as any one of 1, 2, or 3 and i = 1, 2, 3, the system of 
equations 


3A + £ 

dx, p =i dy p dx. 


( 101 ) 


determines the first derivatives dy p /dx,. Again, for t fixed as any one 
of 1, 2, or 3, the system of equations 

— I S Z — dVv — f I — d — 0 (102) 

dx, dx t q=i p-i dy p dy q dx, dx t P -i dy p dx, dx t ’ 


determines the second derivatives d 2 y p /dx, dx t in terms of those already 
determined. 

219. Jacobians and Functional Dependence. In the last section we 
defined the Jacobian determinant of n functions f p with respect to n 
variables y q as the expression (75). This definition and the abbrevia¬ 
tion (76) apply whether the functions f p are functions of the y q only, or 
of .l$$)|e together with other variables, like the f P (y q , x j ) which occurred 
in'theorem on implicit functions. That theorem involved as one 
4xfedition the non-vanishing of the Jacobian for a particular value. We 
ijjjfgall now discuss certain theorems involving the vanishing of the 
Jacobian identically for all values of the variables. 

We first observe that if one of the functions, say /i, is a constant, 
each derivative dfi/dy q = 0. Hence each element of the first row of the 
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Jacobian is zero, and the Jacobian itself is zero. If the value of the 
constant is k, the equation 

fi - k = 0 (103) 

holds, so that the /* satisfy a functional relation. This is a trivial case 
of the more general result: 

If the n functions of n variables , f p (y x ) satisfy a functional relation 

4>(fi,f2, •••,/») = 0, (104) 

and the f p (yi) as well as <t>(f p ) have continuous first 'partial derivatives , 
then the Jacobian of the functions f p with respect to the yi vanishes 
identically. 

It is understood that the functional relation (104) holds identically 
in the yi , and that the function <t>(f p ) is not identically zero in the/ p , so 
that it actually involves at least one of the/ p for all the values considered. 

The equation (104) together with the conditions of differentiability 
have as a consequence the equations: 


df p dy q 


= 0 . 


(105) 


If the Jacobian were different from zero for any one set of values of the 
variables under consideration, this system of linear equations in d<j>/df p 
would have a determinant distinct from zero, and therefore would admit 
only one solution for these quantities, namety d<j)/df p — 0. 

Since the Jacobian is a continuous function, if it were different from 
zero at any one point, it would be different from zero in some k dimen¬ 
sional region including this point in its interior. Hence in this region 
we would have d<j>/df p — 0, so that by the result at the end of section 215, 
the function <f> would be constant in this region. This contradicts the 
hypothesis that the function <t>(f p ) actually involves at least one of the 
functions f p for all the values considered. 

Since the Jacobian can never differ from zero, it must vanish identi¬ 
cally for all values of the y x considered. This proves the theorem. 

As a partial converse theorem, we have: 

If the n functions of n variables f p {yi) each have continuous partial 
derivatives , and the Jacobian of these functions with respect to yi is identically 
zero , then in any region throughout which some minor of the (n — 1 )st 
order is distinct from zero , the functions satisfy some relation of functional 
dependence of the type of (104). 

To prove this, we use the notation of the last section given in connec¬ 
tion with equation (83). If necessary, we so change the notation that 
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C nn is the minor of the (n — l)st order distinct from zero. Then, by 
the theorem of section 218, since the Jacobian of the n — 1 functions 
where « * 1 , 2 , • • •, n ~ 1 , with respect to the n — 1 variables y r) 
where r » 1,2, •••,» — 1 is C nn and hence ^ 0 , the equations 

fsiyryVn) ““ X 9 = 0 (106) 

may be solved for the y r in terms of y n and the x a to give: 

Vr - Fr(x 8 ,y n ). (107) 

Also, we may use these equations to eliminate the y r from f n (y%) and 
so obtain: 

fn(yni&r) ~ fnlFriptiVn)i 2/n]» (108) 

analogous to equation (91). We also have, analogous to the relation 
(93): 

C nn 7 - - (109) 

dy n 

Since J = 0 , while C nn r* 0 , it follows from this that 



Let us now take any particular set of values of and compute a 
particular set of x p ,x 0p from the equations: 

fpiyoi ) x 0 p — 0, p = 1 , 2 , • • • , n. (Ill) 

It follows from this and equations (107) and (108) that: 

* 0 n = ? n (y0n, x 0r). ( 112 ) 

This relation does not explicitly involve the yor, and the right member 
does not change when we vary y n , by equation ( 110 ). Hence the x 0p , 
or values of the f p (yi) satisfy the relation: 

/» -h(y 0 n,fr) = o, (113) 

which is the relation of functional dependence whose existence is asserted 
by thqjheorem. The left member can not be identically zero in the f p , 
since *|$^derivative with respect to /„ is unity. 

A similar result holds if there are more variables than functions. 
Thus, let there be n functions f v (y t ) of the n + p variables y t . Suppose 
that in some region each of the Jacobians of the n functions with respect 
to a set of n variables consisting of yi, 3 / 2 , • • •, y n -i and one other yk, 
selected from y n , * • •, Vn+ P , is identically zero. Suppose also that 
Cnn, Hie Jacobian,of the first n — 1 functions f, with respect to y r , the 
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first n — 1 variables is distinct from zero. Then we may proceed as 
before to obtain the equation: 

jn( Vlcr^r) ~ fn[Fr(.Xa>yk) t 2/fc], (114) 

analogous to equation (108) and the equations: 

df 

—- = o, k = n + 1, n + 2, • • •, n + p, (115) 

dVk 

analogous to equation (110). 

We may then take a particular set of values y 0 t and deduce that if 

* 0 p = f P (yot), (116) 

then x Qn = } n (y ok ,x r ). (117) 


It then follows from the fact that only the j/o* occur explicitly, and the 
partial derivatives of the right member with respect to all the y k are 
zero, by equation (115), that the right member does not change when we 
vary the y k , in consequence of the result of section 215. Hence the 
Xop, or values of the f v satisfy the relation: 

fn~}n(yok,fr) = 0. (118) 

The statement of the result for n + p variables, as well as the original 
theorem for n variables, is incomplete without some condition that 
insures C nn ^ 0. However, in any case where the Jacobian vanishes 
identically, we may find restricted regions in which n functions of n 
variables are functionally dependent. For, if the Jacobian vanishes 
identically, and the functions are not all constants, some minor is not 
identically zero. If N — 1 is the order of some minor of highest order 
not identically zero, we may find some region in which this minor is never 
zero. We may then take the N — 1 functions which appear in this 
minor, and any other function of the set as a set to which the second 
theorem may be applied. However, the functional relation need not 
be the same in two different regions, and some points may not be included 
in any region in which there is a functional relationship. 

220. Integrals Containing a Parameter. If the function f(x,u) is a 
continuous function of x and u for u = u 0 and a g x S b, then 

F(u) = J dx (119) 

is a continuous function of w, for the value u 0 . In fact, for any value of 
x 0 in the interval, there is a 5 <0 such that 

\f(x } u) — /(xo, 4 ^) | < € if \u - Uo| < 5*0, \x - x 0 | < (120) 

We make the usual modifications for the end points. 
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Thus each point considered is the center of a square of side 25 c0 , which 
determines an interval of length 25 e0 on the x-axis, in the xu plane. By 
the Heine-Borel theorem, there is a finite subset of such intervals which 
cover the closed interval a,b. If 5 is the least of the finite set of numbers 
5 f o, then 

| f(x,u) — f(x f u 0 ) | < € if \u — u 0 \ < 8, and a S x ^ b. (121) 
It follows from this that 


and hence 



x' 


f(x,u 0 ) dx 


< e(b — a), 


( 122 ) 


| F(u) — F(w 0 )| < e(h — a) if \u — w 0 | < 5. (123) 

This proves that the function F(u) is continuous at u 0 . 

Suppose next that the function f(x,u) admits a partial derivative with 
respect to u } 

fu(x,u) = £, (124) 

which is a continuous function of x and u for u = u 0 , and a g x g b. 
Then, reasoning for this function as we did for f(x } u) before, we find, 
analogous to equation (121): 

|/ tt (x, u + h) — f u {x,u)\ < e, if \h\ < 8 and a g x g b. (125) 
Next form the difference: 


F(u + h) - F(u ) - £ [f{x, u + h) - f(x,u)] dx. 
By the law of the mean, 

f(x, u + h) — f{x,u) = hf u {x, u + Bh), 0 < B < 1. 

Consequently, for 6, the appropriate function of x, u, and h: 

F(u + h)~ F{u) p b , , , , 

- - - =* J f u (x, u + Bh) dx. 


(126) 

(127) 


(128) 


This leads us to suspect that the limit, when h approaches zero, might be 
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To verify this conjecture, we subtract (129) from the integral on the 
right in equation (128), and find: 

I pb pb j 

J fu( x > u + 6h) dx — J f u (x,u) dx\ 

= J J [/«(x, u + dh) — f u (x,u)] dx 

= j' \fu(x, u + dh) — f u (x,u)\dx. (130) 

Although, for the value of u considered, 9 is a function of x and h, 
0 < 6 < 1, so that \6h\ < S, if \h\ < 8. Consequently we may apply the 
relation (125) and so deduce that the expression (130) < e(b — a), if 
\h\ < 8. Hence, from equation (128), 


F(u + h) - F{u) 


J fu(x,u) 


dx\ 


< e(b - a), if \h\ < 5. (131) 


This proves that the difference on the left approaches zero when 
h —> 0, so that F(u ) has a derivative, and 


dF 

du 



(132) 


This is known as Leibniz’s rule. 

Finally, if a and b are differentiable functions of u y we have from sec¬ 
tion 214, with n = 3, that 


dF 

du 


dF 

du 


^ dF da dF db 

! at& da du db du 


(133) 


From section 129, dF/db = f(b,u). And, since 

F(u) = ~ f( x > u ) dx > Ya = ( 134 ) 


For the first term, we may use equation (132). Hence: 

= f a /«(*»“) + /(M) ^ ~ f(a,u) ~ (135) 


This rule for differentiating the function F(u) defined by equation 
(119), when the limits a and b are functions of the parameter u , is a 
generalization of Leibniz’s rule. 
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EXERCISES X 

1. If w is a function of x, y , z , and t } while x, y, and z are each functions of £, 
show that; 

dw _ dw ^ dw dx dw dy dw dz 
dt dt dx dt dy dt dz dt 

2. If w * f(x } y) and y = £(x,z), show that 


_ d w 

, dw 

dy 

t dx 


x dx 


8 . Let F(x,y) — 0 be the equation of a plane curve, equivalent to y = /(x) 
for values of x near x 0 . Prove that 

F s (x 0 ,yo)(x - x 0 ) + F v (x 0 ,yo)(y - ^o) * 0 

is the equation of the tangent line at x 0 ,yo as defined in problem 11 of Exer¬ 
cises IV. 

4 * In n-space, x* ~ fi(t) r i = 1 , 2, * • • , n are the parametric equations of a 
curve. Suppose that x i0 = and that the/|(£o) are not all zero. Show that 
if the tangent line is defined to be the limiting position of a secant line, the 
equations of the tangent line may be written x* = x» 0 + where u is the 

parameter. 

5. The equation of a hyper-surface of n — 1 dimensions in n-space is 
F(x i, x*, * • •, x n ) — 0, or F(xi) = 0. This will contain the curve of problem 4 if 
F[fi(t)] = 0 identically in t. In particular, F(x^) = 0, and Xi 0 is a point of the 
hyper-surface. The tangent line of problem 4 is called a tangent line to the 
hyper-surface at x»<>. Show that all such tangent lines lie in a hyper-plane whose 
equation is 

£ (j~) (*< - = o. 

«-i \dxi /o 

This is called the tangent hyper-plane to the hyper-surface at the point x< 0 . 

6. In 3-space F(x,t/,z) = 0 is the equation of a surface, and it follows as in 
problem 5 that the tangent plane to the surface at xo,yo,zo or plane containing 
all the tangent lines at the point is: 

(x - Xo)F,(xo,2/o,* 0 ) + (V - yo)Fy(xo } yo,zo) + (z - z 0 )F z (xo,y 0t zo) ~ 0. 

Show that if z ~ f(x,y) t the equation of the tangent plane may be written: 

♦ * — *o ** (x — xo) + ^ ““ 

7. In n-space, the numbers a< determine a direction, that of the segment from 

tint origin 0 to the point A with codrdinates a* The directions a* and ?>*, or the 

n 

eepnent* OA and OB, ate defined ae perpendicular ii and only itYj, ain m 0- 

II 

If the lengths of the segments are defined by the equations IOAJ* - £ a ‘ 
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|OJ3| 2 ■= £ bl, \AB\* = £(£>< — a.) 2 , show that the definition just given is 

*«*1 t«*l 

consistent with the Pythagorean relation, AB 2 = OA 2 + OB 2 . 

8. Using the definitions of problems 5 and 7 show that the direction (~ | 

\dXi/o 

is perpendicular to the direction Xi — x»o or u/*(£ 0 ), that is to any tangent line to 
the hyper-surface at the point x*o- Since it is perpendicular to any segment in 
the tangent hyper-plane, it is considered perpendicular to the hyper-plane, or 

to the hyper-surface at the point Xi 0 . Hence the direction is called the 


/dF\ . 
\dxij o 


is called the 


normal direction to the surface F(x{) = 0 at x 

9. If a» and 6 t - are any two directions in n-space, as in problem 7, the only 
definition of the angle between them consistent with the law of cosines, 

\AB\ 2 — |OA| 2 + |05| 2 — 2\OA\\OB\ cos 8 , makes cos 8 — - . - t with 

i from 1 to n in all sums. When \0A\ ^ 0 and |0J5| ^ 0, this will determine a 
real angle 8 with 0 ^ 8 ^ 7r, if |cos 0| ^ 1. Prove that this last relation must 
hold when a* and bi are real. Hint: Since ]£(a» — xby ) 2 , as a function of x, 
cannot change sign, the quadratic equation (£&<)x 2 — 2(j£ l aibi)x + £a| — 0 
can not have distinct real roots. Hence (2— 4(£&<)(]£a?) ^ 0. 

10. Let w = f(x,y) be a function of x and y to be considered for values near 
x 0 ,yo. Let x = gif), y = h{t) define a smooth curve through xo,yo so that 
x 0 = g(k),yo = *(*>)• Then, if s denotes the arc length of the curve, measured 
from some fixed point in the direction of increasing t , along the curve w is a 
function of s. The derivative of w at x 0 ,yo in the direction of the curve is defined 
as dw jds at to. Prove that this directional derivative is the same for all curves 
having the same tangent line. Also show that it is a maximum when the 
direction has components dx/ds and dy jds which are proportional to (df /dx )o 
and ( df /dy) 0 with a positive factor of proportionality, a minimum for the oppo¬ 
site direction, and zero for the perpendicular direction. Hint: If constants R 
and a are determined from the equations R cos a = (df /dx)o and R sin a = 
(df /dy)o, and 


= sin <f>, 


= R cos (<£ — a). 


11. Let w = f(xi) be a function of n variables to be considered for values near 
Xi 0 . If ai defines a direction and a length \OA\ as in problem 7, the directional 

derivative of w in the direction of a* is defined as — = £ ( — j . Using 

ds i*i \OA\ \dxi/o 

problem 9 to define the angle C between the directions (a and a*-, and 
putting R* « £ (—) > show that dw/ds = R cos C. Hence show that it 

iml \dxi/o 

is a maximum R and a minimum -R in opposite directions along the normal 
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to the hyper-surface f(xi) — /(x*o) at x*o, and is zero for any direction in the 
tangent hyper-plane to this hyper-surface at x* 0 . 

12. A function of n variables x», /(x<), is said to be homogeneous in the x* of 
the fcth degree if f(tx%) = t k f(x x ). Prove the theorem of Euler that for such a 
function 

H Xi — = nffa). 

t=l OXi 


Hint: Differentiate the fundamental relation with respect to t , and then put 
t = 1. 

13. With the assumptions of problem 12, prove further that 



= n{n — 1) • • • (n — m + 1 )/(xi). 


Hint: Differentiate the fundamental relation with respect to t m times, and then 
put t = 1. Note that we must not put y x = x x until after the differentiations 
are completed, and it is incorrect to write the left member with the operator 

( n d \ m 

£ x, % — ) as is done in many texts. In fact, 
i* i dxij 

( n a \m 

Z *i — ) /(*.) = n m f(xi), 

.=1 dxi / 

by repeated use of problem 12. 

14. By section 78, if a partial derivative exists in an open interval, and 
approaches a limit as we approach one end point, the one-sided partial deriva¬ 
tive exists at this point and equals the limiting value. Use this to prove that 


and 


fx(x,y) = lim f z (x + h, y) 
h -+o 


fvx(x,y) = lim f yx (x + h, y) 
h —►O 


lim f X y(x + h,y), 
h-+ o 


in case the limits on the right all exist, and for the last term, if the mixed deriva¬ 
tive is continuous in the open interval. Similar results hold for more variables 
and other partial derivatives. 

x^ — y * 2 

16. If f(x,y) = (x 2 + y 2 ) tan“H^/x), then f xy = j yx = -- -- - -- when x and y 

% H- y * 

are not both zero. From this and problem 14, show that / V x(0,0) = 1, 


fsy( 0 fi) - - 1 . 

x 2 — y 2 

16. If f(x,y) = xy -t--— r, then, when x and y are not both zero, f xy = f yx = 
x* -f- y 4 


where A 


0 when x—> 0 and y—> 0 successively in either 


order n *€f$e this and problem 14 to show that/ v *(0,0) = l,/xy(0,0) * —1. 

17, W* » r cos 6 and y * r sin 0, find the partial derivatives dr /dx, dr jdy> 
d$ jdx and dBjdy by considering these equations as implicitly defining r and 6 as 
functions of x and y. Check by solving the equations, and then differentiating. 
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18. Let f{x,y,z) = 0 and </>(x,y) = 0 , with both the functions/ and <f> differen¬ 
tiable. If d<j> /dy 0 , the second equation defines y as a function of x, and the 
first will then define z as a function of x if df jdz ^ 0. Under these conditions, 
find dz/dx. Hint: Use the relations f x dx + f v dy + f, dz = 0, and <f> x dx + 
<t> y dy = 0, and eliminate dy. The result is dz/dx = (<£*/„ - 4> u f x ) /(<£„/*). 

_ « d(u,v,w) d(r,s,t) d(u,v,w) 

19. Prove that . . — r = —-- . Hint: Use the rule for multi- 

d{r,s,t) o(x,y,z) d(x,y,z) 

plying determinants, = J£a,- p fc p) j. A similar result holds for n vari¬ 

ables. 


ffl.If/( W )-0, prove that (|), (|), (I). 


"I. 


21. Similar to problem 20, show that if /(#») = 0, where there are n variables, 

, , , , ,, . dx n dx\dx<i dx n ^i 

the product of the n partial derivatives — — —--— = ( —l) n , where 

dxi dx 2 dxz dx n 

each derivative is computed with the n — 2 variables not involved kept fixed. 

22. If F(x,y;u,v) = 0 and G(x,y,u,v) = 0, define u and v as functions of x 

•ndp.the,#') 

\dx/ v d(x,v) / d(u,v) 

23. If F(x,y,z) = 0, G(x,y,z) = 0, prove that 


dx dy dz 

Wfi) = d(F,G) = d(F,G) ’ 
d(V,z) d(z,x) d(x,y) 

(dz\ d(z,y) / d(x,y) 

24. If x = f(u,v), y = g(u,v), z = h(u,v), then = ^~) / J(~)' 

25. Prove that a necessary condition for a differentiable function of n vari¬ 
ables to have a maximum (or a minimum) at x tQ is that each partial derivative 
(df /dxi)o = 0. Hint: It must be a maximum wiien each variable x% varies, the 
rest being fixed. Sufficient conditions may be obtained in terms of the higher 
degree terms in the Taylor’s expansion. Such conditions are practically useless, 
and it is generally simpler to investigate the sign of /(x»o) — f(x%) directly. 

26. Show that z = (y — x 2 )(y — 2.x 2 ) does not have a maximum or minimum 
for x = y - 0, although it has a minimum for t = 0 along every straight line 
x = at, y = bt. Hint: z is negative for (small) values of x } y for which 
x 2 < y < 2x 2 (Peano). 

27 . Lagrange’s Multipliers. Let x t - be n = p + q variables subject to the 
q relations F*(a?<) = 0, k = 1, 2, • • • , q. For the values considered, let the 
Jacobian of the functions F k (xi) with respect to some set of q x*, which we take 
as the first q , be different from zero. Then a necessary condition for the func¬ 
tion of the restricted variables /(x*) to have a maximum (or a minimum) at x*o is 

/ df\ « /dF k \ 

that for some set of constants X*, the relations ( —) + £ X* l ^7) “ 0 
are satisfied for i = 1, 2, • • •, n. Hint: For any differentials dx* which satisfy 
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» , n df 

the q equations £ d&i — 0, we must have — dxi * 0, where all the 

partial derivatives are evaluated at x* 0 . For an arbitrary choice of the last 
p dx^ the first set of equations may be solved for the first q dx*. By section 218, 
the dxi so found correspond to possible sets of x* satisfying F*(x t ) ** 0. Next 
we may find constants X*, for k = 1, 2, * • ■, q such that the equations 

9 

df/dxi + XjbdF*/dxi = 0 hold for % *= 1, 2, • • •, q. For the dxi and X* 


determined, we have 


» r 

V 


'i dxi 


0. But, from the choice 


dfldxi+j:\ k dF k /dxi J 

of the X*, the coefficients of the dxi for i — 1, 2, • • •, q are zero. And, as the last 
p dxi are arbitrary, we may take all but one zero and that one distinct from zero. 
Hence the last p coefficients must also be zero. This gives the necessary con¬ 
ditions, which in general have only a finite number of solutions, since there are 
q given equations F*(x<) = 0, and n conditions, to determine the n x< and the 
q X*. 

28 . Inverse Transformations . If Ui(x i,X 2 ,xj), t = 1, 2, 3 are three functions 

m . . ^ „ ■ ,1 ,1 -r 1» ~ |du<| 

ofx/,jf 


, d(Ui.U2 y Uz) 

1,2, 3, with the Jacobian --r or 


dxj\ 


9 * 0 for some range of 


d(Xi,X2,X 8 ) 

the Xjj then for some range of the U{, the x, are determined as functions of the u if 

\ft x J 

Show that the Jacobian of the inverse transformation, n 


dui 


is the 


reciprocal of that for the direct transformation. Hint: Use problem 19. 

29. Curvilinear Coordinates . If in problem 28 the x* are Cartesian coordinates, 

3 

the element of arc length is ds 2 = V dx). Show that in the curvilinear 

3 3 3 . 

coordinates ds 2 * 22 £ £ ^— du p du q . 

fZ i A-i du p du g 

90. Orthogonal Coordinates. In the notation of problem 29, the equations 
U{(xj) = Uio represent three surfaces through a point 0 , or x,*o- Show that the 
normals to the surfaces for i » 1 and i — 2 are perpendicular, according to the 

jdxj dxj 

all choices of p and q 9 ^ p, and all points considered, the coordinates are said to 
be orthogonal. 

3 /q u \2 

31. For the orthogonal co8rdinates of problem 30, let us put £ (fa*) m 

1 ^ . . du v dik , . „ JL „ , „ 

-— and ds 2 = £ hi dui. Hint: 
du p p-i 


definition of problem 8, if ~ ^ ^ ien S ® for 


Deduce the relations hi . 

dx k 


dxk 


, orOif j A:and 1 Ifjf = k. 


7 dugdxf dxj 

using the relations of problem 30, to get «■ — 

tip OUp OXk 

left vanish unless g * p, and those on the right vanish unless j 


du v 


Multiply by and sum fori, 

OX j 


du t 


, since the terms on the 
k. From this 
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dtj dxj 


£ h 2 v h\ 


dtip SUq 
dxj dxj 


= 0 if q ?£ p and — if q » p. Now use 


du p duq 
problem 29. 

3 d 2 f 

32. The Laplacian. The expression £ is called the Laplacian of the 

i-1 oxj 

function f(xj). It occurs frequently in geometry and mathematical physics. 

3 

Prove that in the orthogonal coordinates with ds 2 ,= h 2 v du 2 , discussed in 

p“ i 

problems 30 and 31, the Laplacian is: 

1 f d ^ hfH df \ + _d_ / hzhi df \ + ^hih 2 0/ 

i\) dv,2\h2 du,2/ 


h\h?hi [d^i V hi du\) ' duz \ h% du 2 ) du*\ h$ du^Jj 


Hint: By direct differentiation, ~ = £ —- and — = £ + 

dxj p du P dxj dx) v du p dx) 

From this,£g = £^-£^ 

;=i dr; p dup j ox) 


d 2 f dup du q 


rl&L. 

v h l du % 


df 


du t 


p t Q dup dug dx,- dx y 

transform the coefficient of ~r~ > rewrite the relation of problem 31, ~—- 

du P y dx k 


To 


i ~ , (A) in the form h\ ^, and deduce h\ 

hv oUp dxj du p dx 2 


">p 

d_ 

dxj 
1 dxj d 
hi du p dxj 


( dxj\ 

j\dup/ 


— d 2 Xj dUq 

— 2l -:— -— • By the relation (A), the second term on the left is 

q du p diiq dxj 

1 d 

(h 2 ), or — -— Qi 2 ) when we sum for;. The right member is, by 


hi du v 


• When summed 
d log h q d log h 2 


du v 


du v 


the relation (A): £ ~ £*, or £ A feV 

q dUp du q h^ duq q 2 du p \du q J 

1 A 

for j, this is £ — -— (AJ). Thus we have: £ hj —= £ 

q d'Up ; OXj q 

d , 

=-log-• 

dup * h 2 

33. For cylindrical polar coordinates, x — r cos 6, y = r sin 6, z ~ z. 

dz 2 , and tl 
d 2 f . d 2 f 


d 2 f d 2 f d 2 f 

Show that <k 2 * dr 2 + r 2 dd 2 + dz 2 , and the Laplacian, — -f + ~, is 

dx A dy* dz 2 


transformed to 


l -Ur d A + - 

rdr\ dr) r 2 


■ 2 d6 2 + dz s 


Hint: Use problem 32, 


34. For spherical polar coordinates, x = r sin <£ cos 6, y = r sin <£ sin 0, 2 
r cos <£. Show that the arc length is ds 2 = dr 2 + r 2 sin 2 <t> dB 2 + r 2 d<£ 2 , and the 

1 d 2 f 

Laplacian is ~ ^ { r 2 -f ) + 


t* dr \ dr) 


r 2 sin 2 <f> dB 2 r 2 sin 


— — fsin^V Hint: 
sin <f> d<{> \ d<fr) 


Use problem 32. 



CHAPTER XI 
MULTIPLE INTEGRATION 


The notion of multiple integration arises when we extend the opera¬ 
tion of integration so as to apply to functions of several real variables 
taken over regions of more than one dimension. We shall give a detailed 
discussion for functions of two variables, and two-dimensional regions. 
The modifications necessary to extend the argument to functions of 
more variables in regions of higher dimensionality will then be briefly 
indicated. We then consider certain geometric quantities, such as sur¬ 
face area and volume which are expressible as multiple integrals. We 
also give a few theorems on the transformation of multiple integrals of a 
type much used in physical applications. 

221. Definition of a Double Integral. Let / (x,y) be a function of the 
two real variables x and y, continuous throughout the closed rectangle R : 

a^x^b, c^y^d. (1) 

To define the double integral of / (x,y) with respect to x and y over R, 
we first divide the closed interval a,b into n subintervals by a system of 
intermediate points: 

a = x 0 g xi g X 2 ^ • • • g x n — b. (2) 

Similarly we divide the closed interval c,d into m subintervals by a 
system of intermediate points: 

c = 2 /o g 2 /i g V 2 S • • • g y m - d. (3) 

We then divide the rectangle into N — mn smaller rectangles, by lines 
parallel to the axes, x = x, and y = y,. Let and by, be the dimen¬ 
sions of the ij rectangle, so that 

SXi = Xi - x ^i and by s = yj - yj- V (4) 

Let SA P denote the area of the pth, or ij rectangle, so that 

SA P - SxiSyj. ( 5 ) 

Next select a point £ p ,n P in each closed pth rectangle, and form the 
sum 1 

8 - £/(*„u,) SA P . (6) 

p-i 
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We shall prove that, for any sequence of sums for which 

lim = 0, where B M = max 5x,-, iy jt ( 7 ) 

the sum S approaches a limit, and that this limit is the same for all such 
sequences. 

Since f(x,y) is continuous in the closed rectangle R, it is uniformly 
continuous so that, for any positive quantity«, there is a a, such that 



If we draw all of the parallels to the axes for the first sum, and all those 
for the second sum not already drawn, we will form a new subdivision of 
R into small rectangles. If we denote the area of a typical small rec¬ 
tangle of this set by 5^4*, we shall have: 

(b-a)(d-c). (11) 

The difference of the two sums S and S' may be expressed in the form: 

S - S' - £[/(&,%) - /(&',*')] SA k , ( 12 ) 

where is a point of one of the rectangles used in forming S, and 
is a point of one of the rectangles used in forming S'. Moreover 
these rectangles have points in common. Thus we have: 

|£* — £t| < 25jif < 6, and |% — 7j*| < 25 m <5,. (13) 

Consequently, from the relation (8), the terms in brackets in equation 
(12) cannot exceed «in numerical value, so that, from equations (11) 
and (12) we find: 

|S - s'\ £ «L 5 A h £ c(b - a)(d - c). 


(14) 
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As this relation holds for any two sums satisfying the conditions (10), 
by the Cauchy convergence criterion it follows that any sequence of sums 
satisfying the condition (7) approaches a limit. That the limit is the 
same for all sequences follows directly from the relation (14), since we 
may take S as a sum from one sequence with limit 7, and S' from another 
sequence with limit I', and deduce that: 

\I - I'\ £ e(b - a)(d - c). (15) 

Hence, since e is arbitrary, it follows that 

7 - 7' = 0, or 7' = 7. (16) 

We call 7 the double integral of f(x,y) taken over the rectangle R and 
write: 

I = f f(x,y) dA. (17) 

Jr 

222. Discontinuities. Most of the discussion of Chapter VII could 
be extended to double integrals. We shall not do this in detail, but 
instead shall indicate certain types of discontinuities which do not vitiate 
the results of the last section. 

By the area of a rectangle, we mean the product of the length times 
the breadth. By the total area of a finite set of rectangles, we mean the 
sum of the areas of the separate rectangles. We may now define the 
outer content of P, a set of points in two dimensions, as the greatest 
lower bound of the areas of all finite sets of rectangles including the point 
set P. 

We assume that the function f(x } y) is bounded, and define its oscilla¬ 
tion in any rectangle, or two-dimensional region, as the excess of the least 
upper bound over its greatest lower bound for the region. The oscilla¬ 
tion at a point is the greatest lower bound of the value of the oscillation 
for all two-dimensional regions including the point as an interior point. 
Since we may also define the oscillation at a point in terms of 

f(x 0) yo)f lim f(x,y) and lim f{x,y) (18) 

x,y-*Xt,Va 

analogous to the definition for functions of one variable given in section 
150, the oscillation at ft’ point may be obtained by using rectangles, or 
even rectangles with aides in given directions, say parallel to the x and y 
axes. The osciUatkm of a function is zero at points of continuity. 

Now consider ft function f(x,y) which may be undefined at certain 
points U of the Jrectangle R, but such that the values for all points at 
which it£|4te&ied admit an upper and a lower bound, \f (x,y) | g K. We 
may fftrm ft sum S by arbitrarily assigning any values not exceeding K 
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in numerical value to the points U . If P € is the set of points of the 
rectangle R at which the function is either undefined or has an oscillation 
greater than or equal to €, any positive number, and the outer content of 
every set P € is zero, then any sequence of sums S , given by equation (6), 
which satisfies the condition (7), approaches a limit, and this limit is the 
same for all sequences. 

To prove this, select any positive e < 1. Since the outer content of 
the set P € is zero, it may be included in a finite set of rectangles F of 
total area less than c. Let the sum of the perimeters of the rectangles 
of F , increased by 4 Ne, where N is the number of the rectangles F, be L. 
Then, for any subdivision of the rectangle R with 6m < max (€,e/L) the 
total area of all the small rectangles which include points of P € will not 
exceed the total area of all the small rectangles which include points of F, 
and therefore will be at most 

< + L (z) = 2e - ( 19 > 


Now consider any two subdivisions for which the sums are S and S' } 
with 


$M, each < max 



( 20 ) 


Then, for the subdivision obtained by combining the two original sub¬ 
divisions, we shall have a sum which we may consider as made up of two 
parts, one over rectangles Ri including points of P e , and the other over 
the remaining rectangles R 2 . 

For the rectangles R if we shall have: 

\mm) -/&',%) I ^ 2K, (2i) 


while the total sum of the rectangles Pi is at most 2e. 

Over the remaining rectangles P 2 the sum may be treated in a manner 
similar to that used for the right member of the relation (12). Thus, in 
the present case, we shall have: 

|S - S '| g e(b -a)(d-c)+ 4 eK. (22) 

We may apply to this the same argument we previously used in connec¬ 
tion with the relation (14). This establishes our contention. 

223. Repeated Integrals. Let the function f(x,y) be bounded in the 
rectangle R , and such that the set of points of R } P«, where either f(x,y) 
is undefined, or the oscillation is greater than or equal to c, any positive 
quantity, is of outer content zero. As in the one-dimensional case, we 
may use the phrase content zero in place of outer content zero for the 
reasons given in section 149. We avoid the necessity of considering the 
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points at which the function is not defined by arbitrarily defining the 
function on these points in any way that does not disturb the bounded 
character of f(x,y). Thus we might take the function equal to its 
upper bound on these points, or equal to zero. However it is convenient 
to be able to vary the choice in different applications. 

In particular, the conditions imposed on f(x,y) will be met if the func¬ 
tion is continuous in the closed rectangle R. 

For each value of y in the closed interval c,d the function f(x,y) is a 
bounded function of x, and so has an upper integral with respect to x, by 
section 147, 

F(y) = J f(x,y) dx. (23) 

Since the function f(x,y) is bounded, 

\f(x,V)\ £ K, (24) 


it follows that for each, and hence for all values of y considered : 

\F(y)\ g K(b - a). 


(25) 


Thus the function F(y) is bounded, and so has an upper integral, 



F(y) dy=f dy j f(x,y ) 


dx. 


(26) 


Now consider any subdivision of the rectangle R into N — mn smaller 
rectangles, as in section 221, defined by the points of subdivision (2) and 
(3). We may define an integral similar to that given by equation (26) 
for each pth or ij rectangle, namely, 


hi =f d v f /(*,: 

v i-\ x *~t 


f(x,y) dx. 


(27) 


From the additive property of single upper integrals, we may conclude 
that: 

hy - L hi- (28) 




A gain, if my and Mu are respectively the greatest lower bound and 
least upper bound oif(x,y) in the ij rectangle, we have for each y in this 
rectangle: 

m i} ^ f(x,y) ^ M ij} (29) 


*oA 

so that: V; 


triij SXi Si 


J f(x,y ) 


dx ^ il ^ ii 


mijbxityj & hj Si M{j bit Syj. 


(30) 


(31) 
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Next form a sum S, given by equation (6) and satisfying the condition 
(20). Separate this sum into two parts as we did at the end of the last 
section. For those rectangles R x containing points of the set P t , the 
difference between any term in 8 and the corresponding term will be 
numerically at most 2 K 8x{ 8y 3 \ Since the sum of all the rectangles R x 
is less than 2c, the total difference for this part of the sum will not 
exceed 4Xe in numerical value. 

For the terms corresponding to rectangles R 2 , since the oscillation of 
f{x y y) is less than c, we shall have: 

Mij - rmj < €, and m i3 g /(£,??) g (32) 

Thus the difference for any rectangle ij of S 2 between the term of S and 
the corresponding term will be numerically at most e 8x{ 8y{. For all 
these terms, the total difference will not exceed e(b — a)(d — c) in 
numerical value. 

Thus we have finally: 

|S - I xv \ ^ e(b - a)(d- c) + 4JCe. (33) 

Since the limit of S for any sequence for which 8m —» 0 is /, the double 
integral, we may deduce from the inequality just written that: 

1 1 - l X y | e(6 - a)(d - c) + 4#C. (34) 

Since c is arbitrary, this has as a consequence the equation: 

by = /. (35) 

The argument which rested on the inequality (29) would have been 
equally valid if in equations (26) and (27) we had replaced either or both 
of the upper integrals by lower integrals. This proves that the function 
F{y) is integrable. It also shows that the repeated integral is the same 
as /, the double integral, if we replace the upper integral in equation (23) 
by the lower integral, or any value intermediate between these two. 

We may use the same reasoning with the order of x and y interchanged, 
and thus find that: 

lyx = /• (36) 

We may summarize our results as follows: 

7/ the function f(x,y) is bounded throughout the closed rectangle R, and is 
such that the set of points of R, P t , where f(x,y) is either undefined, or the 
oscillation is greater than or equal to « is of outer content zero, then, if we 
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arbitrarily assign values, bounded as a set, to the 'points where f(x,y ) was 
originally undefined, we shall have: 


J f(x,y) dA - jf dx I f(x,y) dy = J dy J f(x,y) dx. (37) 


In this equation, the upper integrals may he replaced by lower integrals , or 
any value between the upper and lower integrals. 

In particular , if }{x,y) is continuous throughout the closed rectangle R, 
we shall have: 




(38) 


If the function f(x,y) is integrable in x for all values of y , we have: 



X b 

dx J f(x,y) dy. 


(39) 


We may also use this equation if /( x,y) is integrable in y for all values of x 
except a set of one-dimensional content zero, regarding the function to be 
integrated a second time as undefined on this set. However, our con¬ 
ditions on f{x,y) do not necessarily imply that f(x,y) is integrable in y 
for all except a set of values of x of content zero. Thus, let f(x,y) = 0 
for all irrational values of x , as well as x = 0 or x = 1. For any rational 
value of x, 0 < x < 1, p/q in its lowest terms, let f(p/q,y) be zero for y 
irrational, or l/q 3 < y < 1, but let its value be 1/q for y rational and 
0 < y g l/q 3 . 

Consider this function on the rectangle R, 0 < x S 1, 0 g y S 1. 
The only points of R where f (x,y) is at least 1/n are on the lines x = p/q , 
q g n. For a particular q , since 0 < p < q, there are q — 1 lines, and 
the points on each constitute a segment of length l/q 3 . Thus, for a 
given n, the total length of the segments is: 

£(2-l)4< £-2 = L, (40) 

2 q q=»i q 

since the series is convergent by section 192. Thus the segments may be 
enclosed in a finite number of rectangles of arbitrarily small total area 
by including each segment in a rectangle of width c/(L + 1), and length 
so near that of the segment that the sum of the lengths of the rectangles 
does not exceed L + 1. 

Since the function f(x,y) is between 0 and 1/n on R except for a set of 
content zero, it follows that each set P e has a content zero. Thus the 
function does have a double integral and equation (37) holds. However, 
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f($,y) is not integrable for any rational value of x ) a set of one-dimensional 
outer content unity. 

224. Other Domains. Let D be any two-dimensional region of the 
plane, all of whose points are points of some finite rectangle R , and such 
that each straight line through any interior point of the region cuts the 
boundary in exactly two points. Let the boundary have two-dimen¬ 
sional content zero. Consider a function f(x y y) defined at all points of D 
and its boundary, continuous at all interior points of Z), and bounded on 
the closed region D. 

We note that if the boundary consists of a continuous curve with an 
arc length it will necessarily be a set of two-dimensional content zero. 
For, since the boundary has an arc length, we may write x = f(t) and 
y = g(t)> where/(0 and g(t) are each continuous functions of bounded 
variation. Let us make a subdivision of the t interval by points U, into 
intervals g t ^ t t . If c* and e[ denote the oscillation of the functions 
f(t) and g(t) in the ith interval, all the points of the zth arc may be 
included in a rectangle with sides parallel to the axes, and less than 
4in area. Thus the sum of the areas of all such rectangles will be at 
most 

L4€*e( g 4€Af£e<, (41) 

where cm is the maximum of the e t . Since f(t) is continuous, for any 
positive quantity e, cm < c, when the maximum t subdivision is less 
than a suitably chosen 8 € . Again, since g (t) is continuous and of bounded 
variation, by section 173, the sum ]£c' approaches Vg, the variation of 
g(t). Thus the two-dimensional content of the boundary is less than 
4eVg, and thus must be zero since c is arbitrary. 

If f(x,y) is any function, continuous at all interior points of D f and 
bounded on the closed region Z), we may define: 

g(x,y) = f(x,y) for x } y an interior point of D (42) 

and 

g(x,y) = 0, for x,y a point of R not interior to Z>. (43) 

The double integral of g(x } y) over R exists by section 222. We define 
the double integral of f(x,y) over D as equal to that of g{x } y) over R: 

ff(x,y)dA= fg(x,y)dA. (44) 

I'D 

Suppose that, for values of y between y\ and 1J2, a parallel to the x-axis 
cuts the boundary in X\{y) and x%(y). Then, since g(x,y) is equal to 
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/(®,y) in the interval Xi(y), x 2 (y), and is zero outside this interval, we 


have: 


r rt*i(V) 

g(x,y) dx = I f(x,y ) dx. 


(45) 


Let us further suppose that all interior points of D have a y for which 
y t gy £ y 2 . Then from this and equation (38) we may conclude that: 



(46) 


Similarly, if for values between ij and x 2 a parallel to the x-axis cuts the 
boundary in yi(x) and y 2 (x), while all interior points of D have an x for 
which x 2 , then: 




f(x,y) dy. 


(47) 


As in the last section, we may allow f(x,y) to be discontinuous at certain 
points of D, provided that the set of points P„ at which its oscillation is 
greater than or equal to e, any positive number, forms a set of zero con¬ 
tent. In this case, when making the reduction to a repeated integral, 
we may have to replace the first integral by an upper or lower integral, 
or some value between these, as in equation (38). 

We may also extend the definition to any domain D' which may be 
decomposed into a set of points of two-dimensional content zero, 
together with a finite number of domains A of the type previously used, 
putting: 

r f( x >y ) dA = 22 f f(x,y ) dA. (48) 

*'/>' VDi 


In Certain cases, if the integrals over the A are written as repeated inte¬ 
grals, some of them may be combined. 

Finally we may consider domains D", generated by removing from 
a domain of type D' those points which make up some sub-region of 
type D'. The integral over a region D" is defined by an expression 
similar to that in equation (48) with minus signs before the integrals 
corresponding to domains A made up of removed points. 

Certain domains D" may be generated from domains A without any 
additional sets of two-dimensional content zero. We designate by D* 
these domains, generated by addition and subtraction from a finite 
number of regions each of type A 

225. Area. If the domain D is a rectangle R with sides parallel to 
the axes, the integral of f(x,y) * 1 over D or R reduces to the area. 
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Any domain G whose boundary consists of a finite number of segments 
parallel to the axes may be decomposed into a finite number of rectangles 
R } and so for it 

Area G = f dA. (49) 

For any domain D of the type described at the beginning of the last 
section, we may find two domains of type G, G f and G", such that all 
points of G ; are interior points of D, and all points of D are interior points 
of G", and furthermore: 

f dA — f dA < €, (50) 

Jq” 

where c is any given positive number. 

Since we have: 


f dA <> f dA g f dA , 

J Q> J D Jq" 

(51) 

we are lead to define: 


Area D = 1 dA. 

Jd 

(52) 


That area, as here defined, is independent of axes follows from the fact 
that the definition gives the correct value for a triangle or rectangle with 
sides not parallel to the axes. Or we may note that the area is the 
outer content of the set of points of D, which was defined in section 222 
in a manner independent of axes. 

226, The Mean Value Theorem. Suppose that the function f(x,y) 
is continuous in a closed domain D. Let D be connected, that is, have 
the property that any two points of D can be joined by a curve consist¬ 
ing entirely of points of D. 

Then, since f(x,y) is continuous in a closed region, its values are 
bounded, and the greatest and least values are taken on, say 

f(x',y') = m , f(x n >y") « M, (53) 

where 

m <; f(x,y) g M. (54) 

Since the double integral is the limit of a sum of products of values of a 
function by positive multipliers, if the integrand is increased, the sums 
and the integral will either remain unchanged or increase. Thus, it 
follows from the relation (54) that: 


f mdA g f f(x,y) dA £ f M dA. 

Jd «/n %/n 


(55) 
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If we write A for the area of D, 


we have: 



(56) 

(57) 


This shows that the average of the function f(x,y) over D, or 

j J^/(*,y) dA, (58) 

lies between m and M, the values at P f = (x',y f ) and P" = 

Since the domain is connected, we may join these points by an arc, with 
parameter t varying from t' to t". Since f(x,y), regarded as a function 
of t along this arc, is continuous, it takes on every value between m and 
M. In particular, there is a point of the closed region D, (£,*?), such that 
is equal to the expression (58). Thus: 

f f(x,y) dA = Af&rj). (59) 

%J D 

This is the mean value theorem for double integrals which holds for 
integrands continuous on closed, connected domains. 

Whenever the integrand/ (x,y) admits lower and upper bounds m and 
Mj the inequality (54) holds, and we may deduce from it the relations 
(55) and (57). Thus, for any bounded function admitting a double 
integral over D, of area A, we have: 

mA <; f f(x,y) dA g MA , (60) 


where m and M are bounds for the function in D. 

227. Other Subdivisions. Instead of using a subdivision of R into 
rectangles with sides parallel to the axes, we may use any subdivision of R 
into small domains of type D* of section 224 to form a sum S . For any 
function satisfying the condition of section 222, the limit of any sequence 
of sums of this type for which du —> 0, where is the largest diameter 
of any subdivision will be the integral, as we shall now show. 

We note |j|$t, that our condition that the boundary of a domain D be 
met by a^Jme containing an interior point of D in exactly two points 
has, 4 consequence, that if we superimpose the subdivision into 
I# type D* on any subdivision into rectangles of type P, the two 
ivisions will divide the fundamental rectangle R into only a finite 
t of domains of type D*. 
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As in section 222 these may be divided into two groups, in one of which 
the oscillation of f(x,y) is less than e at each point, and such that the 
other group has a total area at most 2e, provided that the rectangular 
subdivision is sufficiently fine. If, now, we take d M sufficiently small, 
so that none of the regions of type D* includes more than four contiguous 
rectangles, we may deduce a relation for the difference of the two sums 
similar in character to the relation (22). It then follows that any 
sequence of sums with (Im 0 will have the integral as its limit. 

228. n-tuple Integrals. The discussion of the integral of a func¬ 
tion f(xk), where fc = 1, 2, • • • , n may now be carried out in a similar 
manner to that used for n = 2. 

We define the volume of an n-dimensional rectangle as the product of 
its n dimensions, and hence define the outer content of a set of points in 
the space of the x k . 

For any n-dimensional rectangular interval, we may form a subdivi¬ 
sion on each axis, and a sum: 

z,m P )sv p , (6i) 

p=i 

where 

dVp = n &x kp ( 62 ) 

k~l 


the n-dimensional volume of the figure with edges bx kp . That is dx kp is 
the subdivision of the interval on the fcth axis, used in forming the pth 
n-dimensional rectangle. 

If any sequence of values of S } corresponding to subdivisions for 
which the maximum dxk P) or dj/ —> 0, approaches a limit, the same for all 
such sequences, we define this as the n-tuple integral of f(x k ). We 
denote it by 



(63) 


where the subscript n on R and V which denotes dimensionality may be 
omitted if it is clear from the context that these refer to n-dimensional 
figures. 

Whenever the function/(:r*) is such that, for every positive quantity 
€, the set of points P c where the oscillation of the function is greater than 
or equal to e, or the function is undefined, has an n-dimensional outer 
content zero, the n-tuple integral exists. 

Moreover, in this case it may be calculated as a repeated integral, 
where if any of the intermediate integrals fail to exist, we use the greatest 
limits of sums, or upper integrals, instead of integrals. 
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We may replace the rectangular region of integration by other 
domains, provided these can be decomposed into a finite number 
of domains of type D. A domain, in n dimensions, is of type D if it is 
such that each straight line through an interior point cuts the boundary 
in exactly two points, and if this boundary is a set of n-dimensional outer 

content zero. The volume of a domain of type D is I dV„, or the 

Jd 

outer content of the set of points of D. 

If /(x fc ) is continuous in a closed connected domain, we have a mean 
value theorem similar to equation (59), namely: 



dV n = Vnf(h), 


(64) 


for some choice of f* as a point of the domain D». 

Whenever the integral exists, if m and M are bounds for the integrand, 
we have: 


mV n g f /(**) dV n g MV n . (65) 

Finally, we may use subdivisions into domains of type D*, instead of 
n-dimensional rectangles with sides parallel to the axes, in forming the 
sums. An n-dimensional domain is of type D* if it may be generated 
by addition and subtraction from a finite number of regions, each of 
type Z>„. 

229. Change of Variable. Consider a set of n equations: 

xt = fdVi), K i = 1, 2, • • •, n, (66) 

for values of y in some n-dimensional rectangle R n . Suppose that, in 
R n , the functions fk(Vi) have first partial derivatives, continuous with 
respect to all n variables, and that the Jacobian: 

difu fa • • • > /n) 
d(yu yz, • • •» Vn) 

Then, since the equations may be written: 

fkiVi) ~ x k - 0, (68) 


dx. 


dy q 


> 0 . 


(67) 


and the terms x* have no effect on the derivatives of the left members 
with respect to the y,-, the Jacobian of this system referred to in section 
2I8||the same as that written in the relation (67), and by the theorem 
ofjMtition 218, the equations may be solved in the form: 

Vi * 4>i(x k ), 


(69) 
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at least in some region including each point Xk, obtained by equations 
(66) from a point 2/« of R n . However, if our conditions hold in the 
closed region R n , by the Heine-Borel theorem we may select a finite set 
of regions surrounding points y it corresponding to the regions surround¬ 
ing points which cover R n . These separate functions may be pieced 
together to give solutions of the type (69), defined for a certain range of 
the Xk, which lead to values of y, in R n . While the resulting relation 
may be selected so as to be continuous for all values considered, and one 
to one in a suitably chosen region including any point, it is not neces¬ 
sarily one to one for all values considered, since the original equations 
(66) may give the same value of the set Xk, for two distinct sets of 
Vk in R n - 

We shall consider only values of y t in D' n , a region of type D in R n , 
which may of course be R n itself. We make the further assumption 
that under the equations (66), the region D„ is carried into D n , a region 
of type D in the x\ t space, and also that the region D' n is transformed into 
regions of type D in certain other spaces to be introduced presently. 

If g(Xk) is any function of the **, continuous in D n , it will determine a 
function G(y,), continuous in D' n in view of equations (66). Under the 
assumptions made, we may show that: 

f g(x k ) dv n = f N G(y<) dV' n , (70) 

J D n \oy q I 

where dV n is the element of integration as in equation (63), which recalls 
that the sums involved the elements of volume given by equation (62) 
for the ^-space, and dV' n has a similar meaning for the 2 /*-space. 

We first note that if this rule is valid for a transformation from a set 
of variables x* to a set and also from the set to a new set zy, the rule 
will hold for the transformation from the x* to the zy, provided that: 

3(Xi, »2, • • • , Sn) d(yi> 2/2, • • • , 2/n) = dfol, *2, • • • , Xn) ^ 

6(2/1, 2/2, • • • > Vn) d(z u Z 2 , • • • , Zn) d(z u Z 2 , ■ ■ ■ , Z n ) 

But it follows from section 214 that: 

(72) 

dzj »-i dy, dzj 

and this may be combined with the rule for multiplying determinants to 
prove the equation (71), as in problem 19 of Exercises X. 

Consequently it will be sufficient to prove the equation (70) when we 
change the variables one at a time, since we may proceed from: 

x u ®2, « 8 » • • •, to yu x 2 , *3. * • •, to 2/i, 2/2, x a , • • •, etc. ( 73 ) 



370 


MULTIPLE INTEGRATION 


[Chap. XI 


The Jacobian for each of these intermediate transformations must differ 
from zero, since their product is that of the original transformation. 
And, by changing the order of the variables in the intermediate trans¬ 
formations, if necessary, we may make all these Jacobians positive. 

We note that, for n = 1, the equation (70) holds since it reduces to 
equation (92) of section 133. 

For the first transformation (73) we have: 

xi = F(y i, x 2l x 3) • • * , x n ), x 2 = x 2) • * •, x n « x n , (74) 
so that the Jacobian is: 


a(F, x 2 , x s , * • •, x n ) = aF ^ 

a( 2 / 1 , ^2, a?3, • • • , a?n) at /1 

We now write the n-tuple integral as a repeated integral, using D n _i to 
denote a domain in the a^-space with the first axis suppressed. We have: 

f Q{x k )dV n = f dVn-x f b g(x k ) dxi, (76) 

J Dn J Dn-l 

where a and b are functions of x 2 , x 3 , • • • , x n . 

By equation (92) of section 133 we may write in place of the inner 
integral: 

J r b ' sF 

g(F, x 2 , x 3 , • • •, x n ) — dy u (77) 

o' °yi 

where a' and b' are functions of x 2 , x 3 , • • - , x„ such that: 

a = F(a', x 2 , • • •, x„) and b = F(b', x 2 , ■ • •, x„). (78) 


These equations show that the n-dimensional domain D„, determined 
by a,b on the xi-axis and Dn-i in the space of the x, is that which corre¬ 
sponds to the domain D" determined by a', b' on the 2 / 1 -axis and D n _ 1 in 
the space of yi, x 2 , • • •, x„. Thus the integral of the expression (77) 
over the domain Z>„_ 1 is equivalent to: 


f g(F, x 2 , x 3 , • • •, x n ) dV". (79) 

JDn dyi 

Since this is equivalent to the first integral of equation (76), and the 
factor in equation (79), dF/dyi, is the Jacobian of the transformation by 
equation (75), we have proved that the equation (70) holds when the 
first variable only is changed. 

IffA similar way the equation (70) holds for the other transformations 
(73J, and so is valid in general. 

The fibove discussion wily applied to domains in which the trans- 
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formation was one to one, and the Jacobian preserved its sign. How¬ 
ever, the formula of transformation may be applied to any domain which 
is the sum of a finite number of parts, in each of which the transformation 
is one to one and the Jacobian preserves its sign, together with certain 
boundary points, provided that the boundary points form a set of zero 
content in all the spaces considered. This follows by applying the 
formula of transformation to each part separately, and summing the 
results. 

If we regard the original transformation as a change of coordinates, the 
volume of the domain D n is: 

f dV n = f 

If the Xk are Cartesian coordinates, dV n is the element of volume as well 
as the element of integration. For the curvilinear coordinates yj t 
dV' n is the element of integration, but \dx p /dy q \ dV' n is the element of 
volume. 

230. Surface Area. Consider a portion of a surface having as its 
equation 

2 = /(*,»), (81) 

where the function / (x,y) is single-valued and has continuous partial 
derivatives throughout some domain D in the x,y plane. 

We subdivide the domain D into small areas, and denote by 8A 
either a typical such small area, or its area. Let 5S be the part of the 
surface which projects on the x,y plane into 8A. For any point of 5$, 
P 0 = (£o> 2 /o>Zo), the tangent plane to the surface will have as its equation: 

2 - Zo = fxo{x - x 0 ) + fyoiy - Vo), (82) 

where = (^)o and f* 0 = (^) 0 ’ ( 83 ) 


^dVl 

dy q 


(80) 


by problem 6 of Exercises X. Let us recall the definitions of problems 8 
and 9 of Exercises X, and denote by y the angle between the 2 -axis and the 
normal direction. Here we take this direction normal to the surface, 
or to the tangent plane, in the direction of increasing z . Then we have: 


u us y 


Vtfo + fy 0 + 


(84) 


Consequently 

j — * j x 0 rjyo T 

f is a continuous function of x and y in 


and sec y : 


sec 7 = V / / I o + fyo + 1 , 

the domain D. 


( 85 ) 
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If ST denotes the portion of the tangent plane at Po which projects 
into SA, we shall have 

&A «* cos y ST, and ST = sec y SA. (86) 

The sum of all the ST is: 

22 0T — £ 860 y SA. (87) 

When the maximum dimension of the SA, du approaches zero, for any 
sequence of subdivisions, the corresponding sums will approach a limit, 
the double integral: 

S= f secy dA Vf* +/* + 1 dA. (88) 

We define this to be the area of the surface. From its form, it is 

independent of the choice of coordi¬ 
nates in the xy plane. To show that 
it is independent of the direction of 
the z-axis, we consider a new set of 
axes x', y', z with the same origin. 
The z f - and z-axes may have arbitrary 
directions. We use such coordinates 
that the y- and )/-axes coincide with 
the line where the planes perpendic¬ 
ular to the z'- and z-axes intersect. 
Then, if the angle in the z'x' plane 
from the z'-axis to the z-axis is 6, we 
have: 

x' = x cos 6 + z sin 0, 

, (89) 

l<ia. 18 . y = y, 

cos 8 + f x sin 8, /„ sin 6 
0 , 1 

— cos 6 + f x sin 0. (90) 

By the definitions of problems 7 and 9 of Exercises X, the direction ratios 
for the normal at Po are 

-U, -u 1 (91) 

and those for *' with respect to the first axes are 

—sin 6, 0, cos0. 


so that: 


a(sV) 

d (x,y) 



(92) 
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Hence, if y' is the angle between the 2 '-axis and the normal, we have: 


, /*sin0 + cos0 d(x',y') 

COS y = 7 == = = = ——— cos y, 

V / /l+/» + 1 ^(*, 3 /) 


(93) 


by equations (84) and (90). From this and the rule for transforming a 
multiple integral established in the last section: 

f sec y f dA f = f sec y'- ~~~- dA = /* sec 7 ckt. (94) 

•'D' Jjr, d(Z,t/) t/JD 


This proves that, as defined, surface area is not dependent on the 
coordinates used. 

231. Intrinsic Definition of Surface Area. An alternative definition 
of surface area, which from its nature is independent of coordinates, is 
the following. We first define the approximate area of a surface element 
as the area of its projection on the tangent plane at any one of its points. 
We then consider any subdivision of a surface into elements, and define 
the approximate area for this subdivision as the sum of any approximate 
areas of each of its elements. Finally we consider a sequence of sub¬ 
divisions of the surface into elements, such that djif —> 0 , where (Im 
denotes the maximum dimension of all the elements for a particular 
subdivision. We shall show that for any such sequence, the approxi¬ 
mate areas approach a limit, the same for all such sequences. This limit 
is defined as the surface area. 

To prove that the limit exists, and that the present definition is equiv¬ 
alent to that of the last section, let us consider a particular subdivision 
of the surface into elements. For any one element, let dS be the area 
as calculated by equation ( 88 ), and T\ be the tangent plane used for the 
approximate area. Denote the projection of 8S on the plane T\ by dT\ 
and use the plane T i as the xy plane in applying equation ( 88 ). Then 

dS = / sec 7 dA — sec y 6T\, (95) 


by the mean value theorem, where sec y is the value of the integrand at 
P, a suitably chosen point of 6S , and so is the value corresponding to the 
angle y between the 2 -axis and the normal at P. 

Since f x and f y are continuous throughout the closed domain D, they 
are uniformly continuous throughout this region. If we divide the 
direction ratios for the normal given by equation (91) by the square 
root of the sum of their squares, we obtain the direction cosines 


v>;+/, s 


+ 1 


m 


~JjL 


V/2+/J + i’ n V/’+zg + i 


(96) 
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These will also be uniformly continuous in D. Hence, when the maxi¬ 
mum diameter (Im of the elements SS is less than a suitably chosen $ t , 
the oscillation of these direction cosines will not exceed «, an arbitrarily 
chosen number which we take less than unity. Let l, to, n be the direc¬ 
tion cosines of the normal to the plane T u and l, to, 71 those at P. Then 
if we write 

\ = l + a,m = m, -\- b,n — n c, (97) 

we shall have a, b, c all numerically at most e. Since 

l 2 + to 2 + n 2 = 1 implies JZj, |to|, \n\ ;£ 1 , (98) 

it follows that: 

cos 7 — 1(1 + a) + to(to + b) + n(n + c) 

= 1 + 30e, where |0| g 1. (99) 

But, from equation (95), 8T X = cos 7 SS, so that 

8 T 1 - 8 S « (cos 7 - 1 ) 8S = 30e 5S. ( 100 ) 

Thus, for the sums approximating the areas under the two definitions, 
we have 

£ 8 T X - £ 8 S = 30'eX SS, where | 0 '| ^ 1. (101) 

But, for a sufficiently fine subdivision, ri.v < o', if S is the integral 
defined by equation ( 88 ), the approximating sum £ SS satisfies: 

\S - £ 6 S| < 6, ( 102 ) 

so that: 

IS *Ti - S\ < 6 + 36 (S + 1 ) g 6(3<S + 4). (103) 

Since this holds for arbitrarily small e, when d_\i is sufficiently small, it 
follows that when da —* 0, the sum T x approaches S as a limit. Thus 
the definition of this section leads to a unique result, and is equivalent to 
the definition of the preceding section. 

232. Intrinsic Coordinates. Suppose that, in a certain u, v domain, 
the equations: 

x = F(u,v), y — G(u,v), z- H(u,v ) (104) 


axe such that each of the three functions has first partial derivatives, 
continuous in u and v, and that 


djXjV) 

d(u,v) 


> 0 . 


(105) 


The%‘|K the theorem of section 218, the first two equations may be 
solvedior u and v in terms of x and y, at least in a restricted range. On 
substituting these values in the third equation, we obtain an equation 
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of the form (81). Thus, in a suitably restricted u,v domain, the equa¬ 
tions (104) represent a portion of a surface. The area of this surface is 
given by equation ( 88 ). But, as in section 218, we find: 


where 


dz t T yz dz J.zx 

dx J X y dy J X y 


_ d(y,z) T _ d(z,s) , T _ d{x,y) 
d(u,v)’ zx d(u,v) Jxv d(u,v )' 


(106) 

(107) 


Thus, by equation (85), 

secy = 

J xy 


(108) 


Here J X y is positive by the relation (105). 

By applying the rule of transformation (70) to the expression for area 
of a surface given by equation ( 88 ), we find: 


S — J* sec 7 dA xy = J* se c y J, 


xy dA UVj 


(109) 


where the subscripts indicate the space in which the elements of integra¬ 
tion are to be formed. We may deduce from equations (108) and (109) 
that: 

<s = f VjJz + Ifx + J% dA uv . (110) 

This is the expression for surface area in terms of the parameters u and v . 
We shall next consider a curve in the surface. Since the equations 

u = u(t ), v == v(t) ( 111 ) 

may be combined with equations (104) to give x, y, and z as functions of 
t; if suitable restrictions as to differentiability are imposed on the func¬ 
tions u(t) and v(t) they will determine a smooth curve in space, which 
also lies in the surface. By section 184, for the arc length of such a 
curve, we have: 

-AiRiMiy* ™ 

To express this in terms of u and v, we use subscripts to denote partial 
derivatives, and use the equations: 
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together with 

dy = y»iu + y*> dv and dz = z u du + dv. (114) 
We find from these that 

dxt + dyt + dz 2 ** E du 2 + 2F dudv + G dv 2 , (115) 
where, with sums ranging over x, y and z, 

E = 2 >£, F = %x u x v and G = 2 >*. (116) 

This enables us to replace equation (112) by: 

We abbreviate this by writing 

ds = Vf du 2 + 2F du dv + G dv 2 . (118) 

By expanding the determinants, and making use of equation (116), 
we find that: 

Jy, + Jl + Jl - EG - F\ (119) 

Thus, we may write in place of the equation (110), 

S =f VeG - F 2 dA uv . (120) 

We abbreviate this by writing 

dS * VEG - F 2 du dv. (121) 

A comparison of this with equation (118) shows that the element of area 
on a surface is completely determined by the expression for the element 
of arc in terms of the parameters u and v. 

This fact could be used in place of the direct argument of section 230 
to show that the definition of surface area there given did not depend on 
the choice of axes. 

233. Signed Elements. So far we have taken the elements of arc or 
volume in two or more dimensions as positive. This necessitated certain 
restrictions. For example, in section 229 we took the Jacobian of trans¬ 
formation as positive. This ruled out such a transformation as 

x' = y, y' = x. (122) 

For this transformation, which interchanges the r61es of x and y, 

d(sV) _. 

^ d(x,y) 

We seek now to broaden our point of view. 


(123) 
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For the integral on an interval, we took the elements as positive at 
first, and then, if a < 6, considered the integral from b to a as the nega¬ 
tive of that from a to 6. We may proceed similarly for the line integrals 
of section 180, Thus for ordinary or line integrals the sign depends on 
the limits, or boundary points. 

Now consider a two-dimensional domain, bounded by a smooth closed 
curve. At each point of the curve, P, points near P on the normal to 
the curve at P are separated by P into an inner segment and an outer 
segment. If we arbitrarily select a direction along the curve as posi¬ 
tive, at any point the angle from the tangent to the curve in the positive 
direction, and the inner normal to the curve will either be 90°, or —90°, 
and will preserve its sign for the whole curve. Since the sign of this 
angle depends on the orientation of the axes, for a particular set of axes 
we may define a positive direction on the curve as that for which the 
angle is 90°, or such that the relation of the positive direction on the curve 
to the inner normal direction is the same as that of the positive x-axis 
to the positive y-axis. We regard this direction as bounding the area 
of the curve taken as positive. Similarly we regard the curve, tra¬ 
versed in the opposite direction, as bounding the area of the curve con¬ 
sidered as negative. 

Similarly, for a closed surface in three dimensions, which bounds a 
volume, we may determine at each point a direction of an inner normal, 
and a direction of an outer normal. In a portion of such a surface, we 
may have u,v coordinates which are determined by curves such that 
any u curve cuts each v curve at a non-zero angle. Let us assign posi¬ 
tive directions to the u and v curves, for example taking the direction 
in which v increases as the positive direction along all curves u equals 
constant. Then, if the orientation of the tangents to the u,v curves and 
the inner normal is the same as that of the x-, y- and z-axes, we consider 
the portion of the surface taken as positive for the u y v coordinates to be 
associated with the volume bounded taken as positive. 

If we are working in a two- or three-dimensional space, we consider a 
particular set of axes for this space as positive. We then regard any set 
of axes with the same orientation as a positive set, and any set obtained 
from a positive set by reversing one axis as negative. In calculating a 
multiple integral, we take dV n as the positive product, or the negative 
of this according as the axes are a positive or a negative set. With this 
convention, we may extend the equations (70) and (80) as well as the 
formula for the element of volume given in connection with the latter 
to transformations where the Jacobian is negative throughout. 

When we are working at the same time with integrals of different 
orders, we begin with the definition of a positive orientation for the 
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largest dimension used. We then use this, and the association of the 
inner normal with the last coordinate, to determine the positive orien¬ 
tation in a figure of dimension one lower, which bounds a surface or 
volume. Thus, from a set of axes in three dimensions regarded as 
positive, we can determine when a set of coordinate curves on a surface 
which bounds a volume is to be taken as positive. From this, we can 
proceed to determine when a curve on the surface which bounds an area 
is to be taken as positive. 

Our conclusions persist if the bounding curves or surfaces are made 
up of a finite number of smooth pieces. We call such curves or surfaces 
piecewise smooth. 

234. Green’s Theorem in a Plane. This theorem asserts that, if P 
and Q are any two functions of x and y for which the partial derivatives 
dP/dy and dQ/dx are continuous throughout the area A, of suitably 
restricted type, then 

jrp*+«*-jr(g-< 124 , 


where the first expression is a line integral as defined in section 180. 
It is taken about C, a closed piecewise smooth curve bounding the area 
A . We assume that the area A is of type D* defined at the end of sec¬ 
tion 224. Both C and A must be taken with a positive orientation in 

accordance with the convention of the 
y 2 \x) preceding section. 

We note that, if x and y are inter- 
x z (y) changed, and P and Q are interchanged 
in equation (124), a minus sign is in¬ 
troduced. This is because we must 
now reverse the direction along the 
curve, or else reverse the sign of the 
element of area, to make the two posi- 
^ tively related for the axes taken in 

reversed order. 

To establish the relation, we first consider the case where the area is 
such that every straight line through an interior point and parallel to 
either coordinate axis cuts the boundary in exactly two points. Then 
if the line with coordinate y cuts the boundary in the points x\ ( y) and 
x$(y) f we have: 

/*%&) XQ 

■ / ^dx = Q(x 2 ,y)-Q(x u y). (125) 

' OX 
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Since the segment xi,x 2 consists of inner points of the area, our con¬ 
vention is such that the direction of increasing y is positive for x 2 and 
negative for xi. Thus, if y r and y n are the least and greatest values of 
y, we shall have: 


f Q(x 2 ,y)dy- f Q{x u y) dy = f Q(x,y) dy. (126) 

O v > On 


If the curve contains a whole segment with y = y', or y", this contri¬ 
butes nothing to the line integral on the right. 

Similarly, if the line with coordinate x cuts the boundary in yi(x) 
and y 2 (x), we have: 


JC 


Vt(x) 

d y 


dy = P( 3 , 2 / 2 ) - P(x,yi). 


(127) 


But, from our convention, the positive direction on the curve is now 
that of increasing x at y i and that of decreasing x at y 2 . Thus we have: 

j* P(x,y 2 ) dx - J P(x,yi) dx = — JP(x,y) dx. (128) 

We may conclude from the last four equations that 

J r* pV" pxtiu) fin px" pVi(x) q p 

P dx + Q dy = / dy I — dx — I dx I — dy . (129) 

r J-u' “xiix/) dx J r ' J uAt\ dy 


But the repeated integrals may be replaced by double integrals over A, 
so that the result (124) follows. 

The equation may be applied to any area A which is the sum of a finite 
number of pieces of the kind described, if the right member is taken over 
the total area, and the left over the entire boundary, which may consist 
of one or more closed curves. If any of the curves bounding parts of ^4 
have arcs in common, these will be oriented oppositely for the two parts, 
since the inner normal of one part will be the outer normal of the other. 
Thus these arcs may be neglected, since the integrals for them cancel. 

236. Exact Differential Expressions. If P and Q have continuous 
partial derivatives dP/dy and dQ/dx , and these are equal in a domain D, 
then for any area A consisting entirely of points of D the integral in the 
right member of equation (124) will be zero. Hence the line integral 


/ 


P dx + Q dy 


(130) 


will be zero over every closed path C in D which is the boundary of an 
area A in D. If M and N are any two points in D, joined by two arcs Li 
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sad Li which together bound an area A in D of simple type, then 


f Pdx + Qdy — f P dx + Qdy = 0. 

** h% 


(131) 


For the difference is the integral over a closed curve, proceeding from M 
to N along the first arc and from N to M along the second arc. Thus the 
integral along L\ equals the integral along L 2 . 

If Lj and Li do not bound an area of simple type, for example if they 
intersect an infinite number of times, we may find a third arc L 3 in D, 
which bounds a simple area with L\, and a simple area with L 2 . In this 
case the preceding argument shows that the integral over L 3 equals that 
over Li and also equals that over L 2 , so that the latter two are equal, and 
again the integral over L\ equals that over L 2 . 

To describe the hypothesis stated, we say that the differential expres¬ 
sion P dx Qdy is “ exact ” in D. If x 0 ,y 0 is a fixed, and x,y a variable 
point in D, we may write 



Pdx + Qdy = F{x,y), 


(132) 


at least in a suitably restricted portion of D. For, in such a restricted 
neighborhood, it will be possible to join x 0 ,y 0 to x,y by paths related like 
the Li and L 2 mentioned above, and we use paths of this type in calcu¬ 
lating the left member of equation (132). Let us take x,y and x + Ax,y 
in the restricted portion of D, and use two paths differing by a straight 
line segment parallel to the x-axis. If x,y is an interior point of the 
restricted region, for Ax sufficiently small, the line segment will lie in the 
restricted region. Then we have: 


F(x + Ax,y) 


F(x,y) - f 

'J r „ 




Pdx. 


(133) 


Since y is constant, this is an ordinary integral, and by the mean value 
theorem is 

Ax P(x\y), (134) 

where x* is a suitably chosen value between x and x + Ax. Thus 


F(x + A x,y) - F(x,y) nt _, A 
- - -* P(x ,V) 


(135) 


From the fact that x / is between x and x + Ax, and that the function 
P(x,y ) is continuous, we may deduce that: 

dx 


P. 


(136) 
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Thus we have 



dF dF 

dF = — dx + — dy = P dx + Q dy, 
dx dy 


(137) 

(138) 


so that when P dx + Q dy is an exact differential expression in the sense 
of this section, there is a function F(x,y) for which P dx + Q dy is the 
total differential as defined in section 211. 

We observe that, if G(x,y) is any second function which has 
P dx + Q dy as the total differential, we have: 


d{F ~ (?) = 0 and 


d(F -G) 
dx 


go F - (?) _ Q 

dy 


(139) 


Hence by section 215, the function F — G is a constant in some suitably 
restricted portion of D. Thus: 

F — G = fc and F(x,y) = G(x,y) + fc, (140) 

so that 

F(x,y) = F(x,y ) - F(x 0 ,y 0 ) = G(x,y) - G(x 0 ,y 0 ), (141) 


and by equation (132) 

f Pdx + Qdy = G(x,y) - G(x 0> y 0 ). 


(142) 


Let us next suppose that we start with the function F{x,y), and form 
its total differential, which we set equal to P dx + Q dy, as in equation 
(138). Then, if the partial derivatives of P and Q exist and are con¬ 
tinuous, by section 213, 


dP _ d^F_ _ jPF_ _ dQ 
dy dy dx dx dy dx 


(143) 


Our discussion shows that, if the derivatives dP/dy and dQ/dx both 
exist and are continuous functions of x and y, the condition 


dJP _ dQ 
dx dy 


(144) 


is both necessary and sufficient for the existence of a function F(x,y) 
which has P dx + Q dy as its total differential. 

When the condition holds, we call P dx + Q dy an exact differential 
expression, and the integral in equation (132) is independent of the path 
of integration for x,y in a suitably restricted region. 
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236. Stokes’s Theorem. If a portion of a smooth surface in three 
space is bounded by a piecewise smooth closed curve C, there is a relation 
analogous to equation (124), namely: 



Pdx + Qdy + Rdz = 





(145) 


In this equation the integral on the left is the line integral taken over the 
curve C, while that on the right is the surface integral taken over the 
area A bounded by C. Each of these is to be taken with a positive orien¬ 
tation in accordance with the convention of section 233. The numbers 
are the direction cosines of the normal, or more precisely of that 
direction on the normal used as the analogue of the 2 -axis in determining 
orientation. As in equation (96), they may be obtained by dividing 
the appropriate direction ratios by the positive square root of the sum 
of their squares. 

For example, if the smooth surface is the x,y plane, the normal to be 
used is the positive 2 -axis, so that the direction cosines are i = m = 0, 
n = 1 and the equation (145) reduces to equation (124). 

The right member of equation (145) is easily recalled if it is written in 
symbolic determinant form: 



m 

Q 


n 



R 


(146) 


where the determinant must be expanded in products of elements ordered 
according to rows, so that the operators of the second row act only on the 
elements of the third row. 

To establish equation (145), it will be sufficient to show that: 

S/ d *-SXi n ~fy n ) iS ’ <147) 

since the equality of the terms in Q and R will then follow by permuting 
the letters. 

If u and v are parameters in the surface, as in section 232, so chosen as 
to give a positive system, we may express the integral in the left member 
of equation (147) in terms of u and v, 




dx 

du 


du + P 


dx 

dv 


dv. 


(148) 
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If A r is the area in the u,v plane bounded by the curve in that plane 
which corresponds to C on the surface, we may apply Green’s theorem, 
equation (124), in the u,v plane and so transform the last expression to: 


/,[f»( p £KK)K 


The integrand is 


dP dx dP dx 
du dv dv du 


since the term in the mixed derivative cancels when the surface is such 
that d 2 x/dudv and d 2 x/dv du exist and are continuous, which we shall 
assume to be the case. 

If we use the relations: 

dP dP dx dP dy dP dz 

du dx du dy du dz du 

dP dP dx dP dy dP dz ** 

dv dx dv dy dv dz dv 

we may reduce the expression for the integrand (150) to 

~T Jxu + T Jzx ’ (152) 

dy dz 

where we use the notation of equation (107). 

This shows that 


Jzx dA 


uv L 


Jxy dA uv 


If we recall equation (70) for transforming multiple integrals, we may 
rewrite the right member as 

(154) 

where the integrals are taken over areas in the zx plane and in the 
xy plane which correspond to A\ 

But because of our convention as to orientation we have: 


dS ~ sec |8 dA zx = — dA zx 
m 


dS = sec 7 dA xy « - dA xy . 

n 
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Here equation (155) is obtained from equation (156) by permuting the 
letters, and equation (156) is obtained from equation (88) and equation 
(96). We took the positive sign for the radical in equation (88) because 
tiie positive area was associated with the standard orientation of the 
x- and y-axes. 

From equations (153) through (156) it follows that: 

f c Pdx = (157) 


which is the equation we were seeking to prove. 

By using equations (155), (156) and the third equation obtained from 
them by permuting the letters, we may write 


/(“-a-we-s-wGH jk 

(158) 

in place of the right member of equation (145). The symbolic form 
analogous to equation (146) is: 



djA y Z 

dA xx 

dA 

d 

d 

d 

dx 

dy 

dz 

p 

Q 

R 


(159) 


In the expression (158) the elements of integration must be given proper 
algebraic signs, determined by the relations: 


dA yt = l dS, dA xx — m dS, dA xv = n dS, (160) 


so that for actual calculation the form (145) is more explicit. 

237. Green’s Theorem in Three Dimensions. If P, Q and R are 
three functions of x, y and z which, with the partial derivatives dP/dx, 
dQ/dy, and dR/dz, are continuous in all three variables in some domain, 
D, we have: 

fM + ^ + ^) iv --f s (p,+Qm+Bn)is - (i6i) 

where iba triple integral on the left is taken over a volume V, and the 
double I^Ngral on the right over a closed surface S which bounds the 
We assume 8 and F lie in D, and the orientations are so 
taka^Milthe x-, y-, z -axes have the same orientation as the parametric 
directiniis for u Mid v in S t followed by the direction of the inner normal 
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to the surface, l, m, n. We also assume that V is a domain of type D*, 
defined at the end of section 228, and that its boundary, S, is a piecewise 
smooth surface. 

We proceed as in section 234, assuming at first that every straight line 
through an interior point of V and parallel to one of the coor dina te axes 
cuts S in exactly two points. Then, for x and y fixed, if the points in V 
form the segment zi,z 2 , we have: 

r dR 

— dz = R(x,y,z 2 )-R(x,y,z 1 ). (162) 

Thus, since the triple integral equals the repeated integral in any order 
when the integrand is continuous, we have: 

/ (dR r 

~dz dV = J { R ( X,V ’ Z2 ) ~ R ( x ,V, z i)]dxdy 

,y,z 2 ) \dA xy \ — JR{x,y,z{) dA xv . (163) 

Our conventions make the inner normal at Z\ in the direction of increas¬ 
ing z, while that at z 2 is in the direction of decreasing z. Moreover, parts 
of S with normals parallel to the xy plane have a projection on the 
xy plane of zero area. Hence we have: 

/ S dv = ~ f s R dAiv= ~ f Rn ds > (i64) 

by equation (156). 

Similarly, the terms in P and Q in equation (161) may be shown to be 
equal. 

If we use the signed elements given by equation (160), we may write 
in place of equation (161): 

X(s+Sr+ f) ■ dV - - [/ p dA - + f Q dA “ + f R dA «]• 

(165) 

The minus sign in equations (161) and (165) disappears if we replace 
the direction cosines by those for the direction along the outer normal, 
and modify the signs of the elements to conform with equation (160). 

The result applies to any volume V which is the sum of a finite number 
of pieces of the kind already discussed, as we may show by an argument 
similar to that used at the end of section 234. 
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EXERCISES XI 

1. Prove that, when f(x,y) is continuous, and a < b 

*b /»6 /%b 


J f*b pb pb px 

dy I }{x,y) dx = I dx I f(x,y) dy. 

a «/ y U a vo 

2, Show that, if f(x,y) is continuous, and for all xo,yo in some two-dimen¬ 
sional domain, 

j r»*0 pvo Q2J? 

dx I f(x,y) dy = F(xo,y 0 ), then —— = f(x 9 y). 
a Jb ax ay 

Conversely, show that if the second condition holds, then 


f* dx r 

J a Jb 


f(x,y) dy = F(xo,y 0 ) - F(a,yo) - F(x 0 ,b) + F(a,b). 


3. Show that the area bounded by the lines a: = a,x = b,y = Oandy = /(x), 

r pb 

f(x) dx, or / y dx, if a < b. 

J a 

4. Show that the area of a domain of type D of section 224 equals the line 

integral — I y dx, taken over C, the boundary of D, in the positive direction. 

Jc 

Hint: Take a new x-axis below the points of C, and use problem 3. Check by 
using Green's theorem. 

5. Deduce I x dy and 1/2 I (x dy — y dx) as alternative expressions for 

Jc Jc 

the area of the domain of problem 4. 

6* Using a procedure similar to that of section 225, with comparison areas 
G f and G" made up of sectors, and noting that the definitions given of content or 
area make area G" ^ area G if G" includes all points of G, show that the area of 

a sector is given by 1 /2 J* r 2 dB, with r — f(6) the equation in polar coordinates 

of the curve bounding the sector, together with 6 = a, $ = b. 

7 . Identify 1/2 J*(xdy ~ y dx), taken along the arc bounding the sector, 

with the integral of problem 6. Hint: Either decompose the sector into tri¬ 
angles and areas like that in problem 3, or else note that x = r cos 0, y ~ r sin 0 

implies that x — — y — = r 2 — • 

F dt y dt dt 

8* Deduce from problem 6 that in polar coordinates the repeated integral 
S^ S f ^ ^ B P resents area * Hence the same is true of the double integral, or 
repeated hafegral in reverse order. For the double integral, verify directly by 




ie transformation formula of section 229 to 


i iA "/ 


dx dy . 
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9. Show that in the transformation to orthogonal curvilinear codrdinates 


h\hih\. Hence show that 


of problem 32 of Exercises X, ["_ h\hlh 2 s . Hence show that 

td{u h u 2t u 3 )J 

J* dxi dx 2 dx 3 = J*h\hy}i$ du\ du 2 duz, taken over corresponding volumes, with 

proper signs given h\,h 2i hz. Hint: Use the rule of multiplication of determinants 
of problem 19, Exercises X and the relations of problem 31 of Exercises X. 

10. For the spherical polar coordinates of problem 34 of Exercises X, show 

that the integral for volume is J* r 3 sin c/> dr d<t> dd. Hint: Use problem 9 . 

11. Let z — f(x,y) represent a portion of a surface, and let the projections in 
the x,y plane of the curves for which y is constant be found. If the area bounded 
by one of these curves alone, or with a fixed boundary independent of the curves 

is H{y), show that the area of the surface may be expressed as j* H'(y) sec y dy . 

Hint: If AH is the area between the curves for y and y + A 7 , the corresponding 
part of S , the area of the surface is AH sec 7 , where 7 is a suitable value between 
7 and 7 + A 7 . 

12. If r 2 = x 2 + y 2 , z = f(r) is the equation of a surface of revolution. Show 
that the surface area between two values of r may be written 2tt J*r ds, where 8 
is arc length. Hint: Use problem 11 . 

13. If one nappe of a cone with vertex at the origin cuts off a surface area & 
from a unit sphere, 0 is called the solid angle for the vertex. If the cone cuts off 
a simple closed curve on any surface, bounding a surface S, show that the solid 

! 0 C cos ( r,N ) pxl+ym+zn «> , 2 . 2 

angle £2=1 - — ~— d*S = I - - - dS, Here r 2 == x 2 + y 2 +r, 




(r,]V) means the angle between the radius drawn from the origin, and the normal 
N to the surface. The direction cosines of N are Z, m , n. 

14. Prove Gauss’s theorem, that the integral over a simple closed surface, 

/ cos (r N) 

— '-A-l — L dS , is 47 r if 8 includes the origin as an interior point, 2r if the origin 
r 2 

is a boundary point of S at which S has a tangent plane, and 0 if the origin is an 
exterior point. Hint: Use the interpretation of problem 13. 

16. If P, Q and R are such functions of x , y and z that J* P dx + Q dy + 
Rdz « f(x,y,z) - /(x 0 ,?/o,zo) is independent of the path joining A 0 = (r 0 ,i/o,«&) 


and A « (; x.y.z ), show that P = > Q = and R = • 

ox dy dz 


Also prove the 


16. Show that if r = >/x 2 + then J g(r)(x dx + y dy + z dz) is 

independent of the path. In particular evaluate the integral when g(r) = r n . 
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dP dQ dR 
17. The relation — -f — + — 
dx dy dz 


0 is a necessary and sufficient condition 
that J* (PI + Qtn + Rn) dS should equal zero when taken over any closed 


surface. An example is P = f(y,z), Q 
18. If P 


dCdB 

dy dz’ Q 


dA dc 
dz dx ’ 


g(z,x), R 
dB 


g(z,x). 


dA 

- - t~ * then 
dx dy 


dP dQ dR 
dx ^ dy T dz 


Conversely, if this last condition holds, there are functions A, B,C for which the 
first three equations hold. Hint: If A is any function, and B is determined to 
within an additive function of y and z by the third relation, then C is determined 
to within an additive function of z from the differential, exact in x and y 


dC ”(ir~ e ) dl + ( p + f) d2/ - 


dP dQ dR 

19* The condition — + — -f — = 0 is a necessary and sufficient condition 
dx dy dz 

that J*(PI + Qm + Rn) dS taken over a portion of a surface bounded by a 

simple closed curve L should depend only on the boundary, L. Hint: For the 
necessity, note that two surfaces bounded by C together make a closed surface, 
and use section 237 or problem 17. For the sufficiency, use problem 18 and sec¬ 
tion 236 to reduce the integral to the line integral J*(A dx + B dy + C dz), 

90. If V is the volume bounded by a closed surface S } N denotes the outer 
normal, and otherwise the notation is as in problem 13, 

r “ 113 fs r cos ( r f N ) dS ~ 1 /3 J* (lx + rny + nz) dS. 

91. If P, Q, R are homogeneous second degree polynomials in x, y and z t and 
S is a closed surface bounding a volume whose center of gravity is at the origin, 


show that J* (PI + Qm + Rn) dS 
22. Show that: 

(du dv 


0 . 


J r a P (du dv du di\ C dv 

A “" + -JA* £ + * U « " Jc “ dN *, 

d 2 v d*v dv 

where 0 jf a closed curve bounding A, A 2 v « , and — is the direc- 

tional derivative of v along the outer normal to the curve C. Hint: Apply 

* dv dv 

Green’s theorem with P 


dv 

-u— and Q 
dy 


dx 
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23. With the notation of problem 22, show that: 

X < “ M ’ - “ 4 '“ ) iA - - X(“s - 's)*- 

This is often called Greeks theorem. 

24. With the notation of problem 22, show that: 

du 


25. Show that: 

: A 2 *; dV + 


f A 2 u dA xy = f 

«/c 


cW 


ds. 


0 JTr C (du dv 
uAhdV + I ( — — 
V Jv \dx dx 


du dv du dv 
dy dy dy dy 


) dV * Is 


dv 

s U dN dS ’ 


d 2 v d 2 v d 2 v 

where S is a closed surface bounding the volume V, A 2 v = — 4- — + > 

dx 2 d?/- dz 2 

dv 

and — is the directional derivative of v along the outer normal to the surface S. 

dv dv 

Hint: Apply Green’s theorem in three dimensions with P — u—~ , Q — wr > 

dx dy 

dv 

R = u~~- 

dy 


26. With the notation of problem 25, show that: 


27. With the notation of problem 25, show that: 

fr A ‘“ dr -£§•*■ 


du 

dN 


^ dS. 


28. We may form multiple Duhamel sums by replacing each y ; - in F(y,) by 
fj(x i, X 2 , • • • , x„) and otherwise proceeding as in section 164. Show that, when 
all the functions are continuous, and we use a sequence of subdivisions for which 
the maximum diameter, 8 M —> 0, the Duhamel sums approach the multiple 


integral 


x 


F [/,(*„)] 


dV n , where dV n = dx\dx 2 • • • cte n< 
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SEQUENCES OF FUNCTIONS 

Similar to a sequence of numbers approaching a limit, we may have a 
sequence of functions approaching a limiting function. When the func¬ 
tions of the sequence are continuous, the condition that the limiting 
function is continuous reduces to the condition that two operations of 
taking limits give the same result regardless of the order in which they 
are applied. An important sufficient condition for this is related to the 
notion of uniform convergence of a sequence of functions. We accord¬ 
ingly introduce this notion and apply it to other problems involving 
two limit operations. In connection with the integral of a limiting 
function we discuss sequences of functions which converge in the mean. 

We also investigate certain conditions under which it is possible to 
select, from an infinite set of functions, a second infinite sequence of 
functions which approaches a limiting function. The conditions involve 
a property known as equi-continuity. We discuss this property, and 
develop certain simple conditions on a sequence which guarantee that it 
is equi-continuous. 

238. Limiting Function. Consider a variable function, f t (x), defined 
over some range of the real variable x for an infinite succession of values 
of t. As in section 17, this succession may be discrete or continuous. 
As an example of a discrete succession of functions, we have the sum of 
the first n terms of an infinite series of functions, 

S„(x) = Z «*(*), (!) 

k-l 

or the product to n factors of an infinite product: 

p»(s) = n [i + (2) 

ik»l 

A continuous succession of functions of the variable x may be obtained 
from any function of two variables g(x,y), defined for 

a & x & b, c & y £ d, (3) 

by the following procedure. Select a particular value of y, say yo, 
tile open interval c,d and for any continuous sequence of values of t 

390 
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the interval c,d with t —> y 0 , define: 

/<(*) = g(x,t), (4) 

so that each function of the sequence is defined for a g x <; b. 

Let us return to the consideration of a particular sequence of functions, 
ft(z). Suppose that there is a function F(x) such that, for a particular 
value of x , say x 0) we have: 

lim ft (xo) = F(x 0 ), (5) 

That is, for x 0) corresponding to any positive quantity e, there is a point 
in the succession of values T(e,x 0 ), such that 

Iftfro) - F(xo)\ < €, for t beyond T(e f x 0 ) (6) 

in the succession of values of t. 

If the relation (5) holds for all values of x 0 in a given range, say the 
closed interval a,b, we write: 

lim/*(z) = F(x), a g x £ b, (7) 


and say that in this range the sequence f t (x) approaches the limiting 
function F(x). 

239, Uniform Approach. As we have indicated in the notation 
T(e } x o), the values of T for which the condition (6) holds will presumably 
depend on x 0 , as well as on c. In fact, it may be impossible to find any T 
that will serve for a given e for all values of x in the range. For example, 
if 


ft(x) = 


tx 

tx + 1 


( 8 ) 


where t steadily increases through all positive values from 0 to + 00 , 
and the range for x is 0 g x g 1, we have 

F(x) = 1, if x 0; and F(0) = 0. (9) 


For Xq > 0, the condition (6) becomes: 

\F(x q ) — /i(x 0 )| = < e. (10) 

txo + 1 

For e < 1, this will hold if and only if: 



t > - - (11) 

Xo 


Thus we may take the right member of the inequality (11) as T(t,x 0 ). 
Any larger value may be used, but no smaller value will serve. 
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Since F( 0) - /,(0) = 0, for all t, (12) 

we may take T(t,0) — 1 for all values of e. 

However, for values of x 0 near 0, the values of 



min T(t,x 0 ) = -- (13) 

are unbounded, since for e fixed and x 0 —»0, the expression on the right 
becomes infinite. 

Thus in this example for any e with 0 < e < 1, no value will serve as a 
T(e,xo) for all x 0 in the range 0|iol 1. 

For some sequences ft (x), for any positive e, there is a value which wall 
serve as a T («,x 0 ) for this e and all x 0 in the range considered. Thus, if 
we consider the sequence of functions defined by equation (8) for all 
values of x in the range 1/2 :S x ^ 1, it follows from the relation (11) 
that 2/t will serve as a T(e,x 0 ) for all x 0 in this latter range. 

To describe the second situation, we define: 

A sequence of functions f t (x) approaches a limiting function F{x) uni¬ 
formly in xfor a certain range, if, for any given small positive quantity e, 
there is a value t„ independent of x, such that 

|F(x) — f t {x)' < «, for t beyond t ( , (14) 

for all x in the range considered. 

We use the phrase uniform convergence, to indicate that the limiting 
function is uniformly approached, and non-uniform convergence to 
indicate that this is not the case. In particular, we say that an infinite 
series or product whose terms are functions of x converges uniformly in a 
certain range, if the partial sums s„(x), or partial products, p n (x) 
approach their limits uniformly for this range. 

As the example (8) show's, we may have approach to a limit non-uni¬ 
form in one range, but uniform in some smaller range. 

240. The Cauchy Criterion. If a sequence of functions converges 
uniformly for a certain range in x, for any given positive quantity tj, 
we may take t = y/2, and find a l' equal to a t, for which the relation (14) 
holds. If then, u and v are any two values which follow t' in the succes¬ 
sion, of values, we may put x = u, e = tj/2 or x = v, t = r//2 in the rela- 
(14). From this, as in section 26, we may conclude that: 

:*/ l/«(*) -/»(*)!< V, for u,v beyond t', (15) 

and all x in the range considered. Thus, when the convergence is uni¬ 
form, the Cauchy condition holds uniformly throughout the range, in 
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the sense that there is a i! for which equation (15) holds which depends 
on e but is independent of x. 

Conversely, if the Cauchy condition may be satisfied for a sequence of 
functions ft{x) } for every positive value of e, uniformly throughout a 
certain range, then the sequence of functions f t (x) approaches a limiting 
function F(x) uniformly for this range. 

For, by the result of section 26, for any x 0 in the range, the sequence 
of values /*(x 0 ) approaches a limit. We define the function F(x) at x 0 
as the value of this limit. 

For any positive quantity tj, select rj ; with 0 < r\ < 77 . Then there is 
a i! independent of x, such that the condition (15) holds for r\\ Thus, 
for any x 0 in the range: 

|/u(x 0 ) ~ /r(zo)| < for u,v beyond t '. (16) 

Since this relation holds for all v beyond t' y we may let v run through the 
sequence of values of t beyond t\ Then, since under these conditions 

f v (x 0 ) —»F(x 0 ), we may conclude from the relation (16) that: 

IjfuOr, 0 ) - F(x 0 )\ ^ 77', for u beyond t'. (17) 

Since r\ < rj, and the value of t f is independent of x 0 , it follows that: 

|/t(x) — F(x) \ < v, for t beyond t\ (18) 

which is the condition for uniform approach to a limit. 

Our result may be formulated as a theorem: 

A necessary and sufficient condition for a sequence of functions f t (x) 
to approach a limiting function F(x) uniformly is that the Cauchy condi¬ 
tion (15) can be satisfied for every positive c, uniformly in x for the range 
considered , that is } by values of t f independent of x. 

241. Interchange of Order of Limits. Consider the values of F(x) t 
near x = a, where F(x) is the limiting function of a sequence ft(x). If 
these values approach a limit, it is 

lim F(x) = lim | lim /*(x)l • (19) 

x—+a x—H3 L t J 

Again, if the limits exist, we may take the limits on x and t in reverse 
order and consider: 



(20) 
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Even when all the limits exist, the results of (19) and (20) may be 
different. Thus, for the sequence defined by equation (8), and o = 0, 
we have: 



lim j" lim 1-1, 

x—+0 U-++O0 kc + 1 J 

(21) 

while 

lim [" lim 1 = 0. 

L. x-»0 tX -p 1_J 

(22) 


However, for some sequences f t (x) the two combinations of operations 
given by the expressions (19) and ( 20 ) do have the same value. We 
give a sufficient condition for this in the theorem: 

If lim ft(x) = F(x) exists, and the approach is uniform for some range 

t 

in x including the value x — a, and lim f t (x) = G(t), for all t beyond a 

f x—*a 

certain one i" in the sequence, then: 

lim lim f t (x) I and lim lim f t (x) (23) 

x—+a L t J < J 

both exist and are equal. 

From the assumed uniform approach, for any positive quantity e, 
there is a t t such that, for all values of x in the range: 

[/t(x) — F(x)| < e, for t beyond t ( . (24) 

We take l t beyond t". Then, for u and v each values of t beyond t„ 

we have: 

|/„(*) -Mx)\ < 2e, for u,v beyond t,. (25) 

Since this relation holds for all x in the range, we may let x —> a and 

deduce that 

\G(u) — Cr(t>)| ^ 2t, for u,v beyond t ( . (26) 

This is the Cauchy convergence criterion and since it holds for any value 
of t, with a suitable t t , we may conclude that, as t runs through its 
succession, G(t) approaches a limit. Let A denote this limit. Then: 

A — lim G(t) = lim Jlim /<(*)[• (27) 

t t L x—*a J 

Let us now select a particular value of t beyond t, for which G(t) is 
within e of its limit A. We denote this by w. Then 

/ \A- G(w) | < *. (28) 

But by the relation (24) which holds for t = w, 

If *(*) - F(x)\ < «. 


(29) 
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Again, since f w (x) approaches G(w) when x-*a, there is a 5 such that: 

|(?(w>) -/u,(x)| < «, for \x — a\ < 6. (30) 

From the last three relations we may conclude that: 
if |* - o| < S, | A - F(x) | < 3«. (31) 

This proves that: 

lim F(x) = A, (32) 

X —HI 

or A = lim lim/*(:r) * (33) 

X—KI L t J 


Equations (27) and (33) together show that the two repeated limits 
each exist and have equal values. This is the conclusion of the theorem. 

242. Two-Dimensional Limits. The theorem of the last section holds 
when x —> a is replaced by x —► a+ . In this case it is sufficient if the 
range of uniformity includes a as a left end point. Similarly we may 
have x —»a—, or x —► + 00 , or — oo. With these extensions, x and t 
play coordinate rdles. Thus we are led to write g{x y t) in place of / t (x). 
If we replace t by y , and for definiteness consider the case where x —► a 
and y the theorem shows that if for all x in some interval includ¬ 
ing a, lim g(x } y) exists and if lim g(x,y) exists for all y in some interval 

v—+b x-+a 

including b y and if one of these limits exists uniformly in the variable 
held fast for all values in its range, then the repeated limits both exist 
and are equal: 

lim lim g(x,y) = lim lim g(x y y) . (34) 

x—+a Ly—’J V—+b L.r—J 

A related, but not identical question, is the existence of the double or 
two-dimensional limit: 

lim g(x y y) = A. (35) 

+a,b 

We define this by a method analogous to that used in section 35 to 
define a continuous function of two variables. That is, we write the 
relation (35) if, for any positive «, there is a 5 such that: 

if |x — o| < 5, \y — 6| < S, \A — g(x,y)\ < t. (36) 

As in section 35 we may show that this is equivalent to requiring that 
for every discrete sequence of points (x„,y„) for which x n -*a, y n -+ b, 
we have lim g(x n ,y n ) - A. 

We may prove that, if one of the repeated limits exists and if the inner or 
first limit exists uniformly with respect to the second variable throughout the 
range used for it in the repeated limit, then the double limit exists. 
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For, if when y~-*b, g(x>y) approaches F(x ) uniformly in y , for 
\x — a\ < A, we have for some 5 


|F(x) - g(x,y)\ < e for \y - 

b\ < 5', |x — o| < h. 

(37) 

And, if the repeated limit exists, 



A = lim lim g(x,y) 

1 = lim F(x). 

(38) 

x—+a L 

J X — 


Thus, there is a S" < h such that: 



| A - F(x)| < £ for 

Si 

1 

A 

(39) 

We may conclude from the relations (37) and (39) that: 


1 A - g(x,y) | < 2e, if |x - 

«l <5, \y - b\ < 5, 

(40) 


where 5 is min This is essentially the relation (36) which defines 

the double limit, so that the double limit exists, and equals the repeated 
limit under the assumed conditions. 

Since the conditions of the theorem of section 241 include the uni¬ 
formity and imply the existence of the repeated limit, when these con¬ 
ditions hold, the double limit exists and equals the common value of the 
two repeated limits. 

However, the theorem just proved may apply when only one of the 
repeated limits exists. Thus, 

if g(x,y) = y Sin - > x 0, g(0,y) = 0, (41) 

X 

and if we take 0,0 as the a,b of the discussion we have: 

lim [lira 0 (x,y)l = 0, (42) 

with the limit for y uniform in x, so that the double limit exists and 
equals zero. However, when y 9 * 0 and x —* 0, g(x,y) does not approach 
a limit, so that the repeated limit in the reversed order does not exist. 

We also note that the double limit may exist, without either repeated 
limit existing. An example, with a ,b = 0,0, is: 

g(fi,y) = 9(x, o) « o, 

and 9(z,v) — (x 2 + V 2 ) sin - sin - if x j* 0, y 5 * 0. (43) 

x y 

243. Continuous Limiting Function. The equations (8) and (9) 
show that the limiting function may be discontinuous on a range even 
if all the functions of the sequence approaching it are continuous on the 
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range. However, if all the functions f t (x) are continuous at the point, 
and the sequence approaches Fix) uniformly in x for some range includ¬ 
ing the point a as an interior point, then F{x ) is continuous at a. For, 
by the theorem of section 241, we have: 

lim lim f t {x) = lim | lim ft(x)\ . (44) 

x-+a L t J t Lz-ki J 

But each function f t (x) is continuous at a, so that: 

lim f t (x)=f,(a). (45) 

X —►O 

From this and the fact that: 

lim/((;r) = Fix), (46) 

t 

we may deduce from equation (44) that: 

lim F(x) = li mftia) = F(a), (47) 

x •—►a t 


which is the condition that F(x) be continuous at a. 

The same result holds for a range, and consequently we have the 
theorem: 

The limiting function F(x) of a sequence of functions f t (x) is continuous 
in any range in which the separate functions f t (x) are all continuous , and 
the sequence approaches F(x) uniformly. 


Since elementary operations do not disturb continuity, if the terms 
of an infinite series are each continuous on a range and the series con¬ 
verges uniformly for this range, then the sum of the series is continuous 
on this range. 

Again, if the factors of an infinite product are each continuous func¬ 
tions on a range and the product converges uniformly for this range, 
then the function given by the infinite product is continuous on this range. 

In all these results the range may be a closed interval, the result hold¬ 
ing for the end points by our conventions as to continuity at these 
points and the fact that our basic theorem holds for x —> a+ or x —■> 6—. 

244. Improper Integrals. Let 



(48) 


be a convergent improper integral for all values of the parameter x in a 
certain range. Then, for x in this range 

F(x) = lim I g(u,x) du. 

*-*oo J a 


(49) 
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Thus we have a sequence of functions: 



g(u,x) du, 


(60) 


converging to a limiting function. By the Cauchy criterion of section 
340, the sequence will converge uniformly if, for each positive«, there is a 
t, such that: 

I/<-(*) -/*"(*)I = g{u,x) du < t, for t', t" > <«. (51) 

In case g(u,x) is a continuous function of u and x for all values of 
« > a and all x in the range, the integral in equation (50) is a continuous 
function of x, by section 220. Hence, if this is the case and if we have 
uniform convergence for x in the range, by the theorem of section 243, 
the limiting function or the improper integral in equation (48) will be a 
continuous function of x. 

With slight modification the discussion applies to improper integrals 
of the second kind. 

We may define improper repeated integrals as the limits of proper 
repeated integrals. If the repeated limits 


lim lim I du I f(u,v ) dv 

*—►00 L y—►« J o ^ b J 

lim j lim f*du f f(u,v) dv 1 

y-WO 0 L ►« *J a J b J 


(52) 

(53) 


both exist, we may deduce from the fact that: 


r pV pv pX 

du J dvf(u,v) = J dv J f(u,v) du 


that tiie improper integrals 


CO 00 » 00 

J duj dvf(u,v), and j dv J f{u,v ) 


(54) 

(55) 


exist and have the same value. 

If either erf the integrals in (55) exist when f(u,v) is replaced by 
fl(tt,») where |/(u,t>)| S g(u,v), then both the integrals exist and are 
equal as we see by considering the double series of positive terms 

pm+1 

■ du I g(u,v) dv. (56) 

n "m 
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245. Wcierstrass M-test for Uniform Convergence. An important 
and useful test for uniform convergence of a series is contained in the 
following theorem: 

If HAfjt is a convergent series of positive terms and if £w*(x) ( s a series 
of functions, and if for all k, and all x in a certain range, 

|wjt(x)| g M k , (57) 


then the series u k (x) converges uniformly in x for the range in question. 


Since the series with terms M k converges, by the theorem of section 
188, for each positive quantity e, there is some positive integer N t , such 
that, for any integer k > N t , and all positive integers p 

|Affc+i + 2 + • • • + M k + P | < «. (58) 


But it follows from the condition (57) that: 


p 

2m ^-k+r (x) 


r®» 1 


= Z \ u k-\~r(x)\ ^ Z Mk+f. 

r = 1 r*1 


(59) 


Since the M k are all positive, the last sum is the same as the sum in the 
left member of the relation (58), and: 


Z U k +r(x) 

r ~ 1 


< c, if k > N € and p > 0. 


(60) 


That is, the partial sums of the series with terms u k (x) satisfy the 
Cauchy convergence criterion uniformly in x for the range considered, 
and therefore by section 240 the series converges uniformly in x for this 
range. This proves the theorem. 

The condition of the theorem is sufficient but is not necessary. In 
fact, for some uniformly convergent series there may not be any series 
of constants M k for which the condition (57) holds with M k the terms of 
a convergent series. 

For example, let the range be 0 g x ^ 1, and let 

w*(x) = 0, if x ^ | , and u k ^ • (61) 


The remainder after N terms of the series will be less than e, if N > 1/e, 
so that the series converges uniformly. However, any M k satisfying the 
condition (57) for the entire range will have M k S: l/k, so that the series 
will diverge. 

In place of using a convergent series of positive constants, we could 
use a series of positive functions of x, m*(x), uniformly convergent in x 
for the range in question and such that, for this range: 

|«fc(*)| ^ m k (x). 


( 62 ) 
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In this case, we deduce from section 240 that for some N t , 


p 

X m k (x) 


r*»l 


< €, if k > N< and p > 0, 


(63) 


We may use this in place of the relation (58), and complete the argument 
exactly as before. 

We describe the relation (62) by saying that the function m*(x) 
dominates the function Uk(x). To indicate that this holds for all k, 
we say that the series ^mk(x) dominates the series J^Uk(x). Thus the 
result just proved may be stated as follows: 

An infinite series of functions converges uniformly in x for a range if it is 
dominated by an infinite series of positive functions which converges uni¬ 
formly in x for the range. 

In this and the preceding theorem, since the argument applies equally 
well to the series YL\ u k{x)\, it follows that the series converges absolutely 
for any x in the range. 

We may extend the considerations to improper integrals and prove 
that: 

The improper integral 



(64) 


converges uniformly in xfor a range if, for all u ^ a, and all x in the range , 


\g(u,x)\ S M(u), 


(65) 


where M(u) is a function , necessarily positive or zero, for which 

JT M(u) du (66) 

converges. 

The proof depends on the fact that the relation (65) implies that: 

g(«,x)du|^ f \g(u,x)\ du f* M(u)du. (67) 


This enables us to proceed from the Cauchy criterion for the sequence 
of integrals approaching the integral (66) to the Cauchy criterion for 
the sequence of integrals approaching the integral (64), as expressed in 
equatkM| . (51). Since the latter then holds uniformly in x, the uniform 
coiiflaj^ence of the improper integral follows. A similar result holds for 
an improper integral of the second kind. 

We have stated the result for a function M (u) independent of x, 
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because this is the most important case in practice. A more general 
result is: 

The improper integral of g(u,x ) with respect to u converges uniformly in x 
for a range X, if, for all values of u in U, the range of integration , and all x 
in the range X, the function g(u,x) is dominated by a function m(u,x) } 
necessarily positive or zero, for which the integral with respect to u over the 
range U converges uniformly in xfor x in X. For any x in X, the improper 
integral of g(u,x) converges absolutely. 

This is proved by similar reasoning, using the relation: 

\g(u,x)\ ^ m{u,x), u in U, x in X, (68) 


to prove that: 




\g(u,x)\ du g J* m(u,x) du . 


(69) 


The range U of u may be a, <x> as in equation (64), or a,c for an 
improper integral of the second kind. 

The Weierstrass AT-test depends on the application of the comparison 
test for convergence. Any other test for the convergence of an infinite 
series, improper integral, or infinite product may be used to establish 
convergence uniform with respect to x if the test determines a place in 
the sequence, independent of x, beyond which the difference between the 
approximation and the limit is small. 

246. Integration of Series. For a sequence of functions, the limit of 
the sequence of integrals, as well as the integral of the limiting function 
of the sequence, may both exist without being equal. An example is: 

ft(x) * 6“** 2 tx. (70) 


Here we have: 



e 1x2 2 tx dx 


i 



o 


n ~t 


so that: 


But: 


lim f e txl 2 tx dx = 1. 

t-H-» ** 0 


lim e txl 2 tx = 0, 

t—►4 -g© 


(71) 

(72) 

(73) 



lim (e~ tx2 

i-.+® 


2 tx) dx 


= 0. 


(74) 


so that: 
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However, we may prove a result of somewhat similar character to that 
of section 241, namely: 

If each of the functions ft(x) is continuous in x for the range a £ x £ b, 
and if /<(*) approaches a limiting function F(x) uniformly in x for this 
range, then: 

lim / f t (x)dx and I lim f t (x) dx (75) 

t *f a J a t 

each exist and the two have the same value. 

By the theorem of section 243, the limiting function Fix) is continuous, 
so that it has an integral. Thus: 

f lim f t (x) dx — f F(x) dx, (76) 

t 'la 

exists. 

From the assumed uniform convergence, for any positive e, there is a 
t„ such that: 

|F(x) —/ t (a;)[ < e, for t beyond l t , a £ x £ b. (77) 
£ It follows from this that: 

I J F{x) dx- f f t (x) dx\ = \ f [F(x) - f t (x)] dx 

J a ** a j | ** a 

^ f\F(x) -f t (x)\dx 


This shows that: 


^ |t> — a|«. 


ft(x)dx= I F(x)dx, 

a J a 


(78) 


(79) 


so that the limit on the left exists. A comparison of equations (76) and 
(79) shows that the two limits are equal, as stated in the theorem. 
Corresponding to a series of integrable functions £m*(x), we may form 

a series £ J' u*(x) dx, which we refer to as the integrated series or the 

series obtained by termwise integration. For a finite sum, we have: 


n /»* px n 

£ / Uk(x) dx = I £ ut(x) dx. 
km\J a J a k -1 


(80) 


If the ut(x) are all continuous functions, the partial sum of the series to 
ntentns, 

' n 

«»(*) - £ «*(*) 
k «*1 


(81) 
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will be a continuous function. If the series converges to s(x) uniformly 
in a range o g i g ft, we may apply the theorem just proved to s„(x), 
and deduce for any x in this range: 


lim 

n—►« 


r 


8 n (x) dx 



(82) 


As the integral on the left is the series obtained by termwise integration, 
it follows that under the conditions stated the series converges to the 
integral of the sum function of the original series. 

Furthermore, for 

a<.b^B, (b - a)t g (£ - a)t. (83) 


Thus the inequality (78) holds with right member (B — a)c, for all b 
satisfying the relation (83). This proves that the convergence of the 
first integral of (75) is uniform in b. 

These results are expressed in the following theorem: 

An infinite aeries of continuous functions which converges uniformly in x 
for a :§ x £ B to a sum function s(x) may be integrated termwise over the 
range a,x to give a new series which converges to the integral of s(x) from 
a to x. The convergence of the integrated series is uniform in x, for 
a g x g B. 


We may also apply the first theorem of this section to improper inte¬ 
grals. If the improper integral 



(84) 


converges uniformly in x, for x in the range a £ x £b, we have: 

J r*?> /»« pb pi 

dx I g(u,x) du = lim I dx I g(u,x) du. (85) 

a J r 

But, for the proper integral of a continuous function of two variables: 

X b pt pi pb 

dx I g(u,x ) du = / du I g(u,x) dx, (86) 

so that under the assumed conditions: 

/»® /»« pS 

dx J g(u,x) du * J du J g(u,x) dx. (87) 


A similar result holds for 
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where the integrand g(u,x) is continuous in the two variables for 

a ^ x ;£ b and r u < c, and the integral J g(u,x) du is an improper 

integral of the second kind, which converges uniformly with respect to 
x for a g x £ b. 

247. Dominated Sequences. If, for all t sufficiently far out in the 
sequence, 

l/*(*)l ^ gfr), (89) 

we say that the function g(x), necessarily positive or zero, dominates the 
sequence ft(x). 

We may prove the result of the theorem given in equation (75) with 
the conditions relaxed near a finite number of points, provided that in 
some interval including each of these points, the sequence is dominated 
by a function g{x) integrable over this interval. It will be sufficient to 
consider one such point, taken as the right-hand end point, and then 
formulate the theorem in detail for this case as follows: 

If each of the functions f t (x) is continuous in xfor the range a g x < c, 
fi{x) approaches a limiting function Fix) in this range and the convergence 
is uniform in x for each range a ^ x g b, where b is any number such that 
a < b < c, then if the sequence is dominated in some open interval c',c 
by a function g(x), integrable in this interval, 

J r*c pc 

ft{x) dx and I lim f t (x) dx (90) 

a v a t 


each exist and the two have the same value. 

To prove this, we select a small positive quantity e, and a number c", 
such that c < c" < c and 

J g(x) dx < e. (91) 


We may do this since g(x) is integrable in c , c. And, since g(x) g 0, 
we may take c" > a. 

Since each function ft(x) is continuous in the range a £ x < c and 


dominated by 

an integrable function in c',c, the integral 

J f t (x) dx 

* (X 

exists. Also, 




j%c pC —h 

J f t (x) dx = J f t (x) dx + dt, 

(92) 

where 

|0| 3a 1 if c" < c — h < c. 

(93) 
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Again, by the first theorem of section 246, we may deduce the existence 
and equality of 

„c-h 

ft(x) dx = I lim f t (x) dx. (94) 

a J a t 

But, since the integrand on the right is dominated by g (x) in c',c it follows 
that the integral exists with upper limit c and that: 

J f%c s*c—h 

lim ft(x) dx = I lim f t (x) dx + d't, (95) 

a t Oa t 

where \d'\ Ik 1. 

If we take t' such that for t beyond t' in the sequence the integral in 
the left member of equation (94) is within € of its limit and take account 
of equations (92) and (95), we find: 


I lim ft(x) dx - I f t (x)dx 
I J a t Ja 

Since e is arbitrary, this proves that: 

lim / f t (x)(Lx= I lim f t (x)dx 

f a l 


^ 3e, t beyond t f 


(96) 


(97) 


and the conclusion of the theorem follows. 

In particular, this theorem holds if the functions/*(:r) are all uniformly 
bounded, since in this case we may take g(x) as a constant. 

The theorem may be applied to series, as in the last section, if the 
partial sums are uniformly bounded or are dominated by an integrable 
function. 

We may also apply it to improper integrals. It sometimes enables us 
to reverse the order in a repeated integral where both integrals are 
improper, if for one inner integral the convergence is uniform for the 
modified outer range and otherwise dominated by an integrable func¬ 
tion. For example, if in addition to the conditions used to justify 
equation (87) we have: 

g(u,x) du S G(x) y c < x, (98) 


x 

with G(x) integrable from c' to <x>, we may conclude that 

X aO y*» /»* /»®° 

dx I g(u,x) du - I du I g(u,x) dx. 

248. Differentiation of Series. Suppose that the sequence of func¬ 
tions ft(x) is such that 

lim f t (a) = F(a), (100) 


(99) 
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and that the sequence of continuous functions gt(x), where 

9t(x) = “/<(*) ( 101 ) 


converges to a function G(x), uniformly in x in the range a g * ^ b. 
Then we may conclude that there is a function F(x) to which the first 
sequence ft(x) converges, and 


F'{x) = G(x). (102) 

For, if we apply the theorem of section 246 to the sequence Qt{x), we find: 

lim j* g t (x) dx = J ** G(x) dx. 

We also have: 

(103) 

f* 9 t(x) dx = J** dx - f t (x) - f t (a), 

so that: 

(104) 

ft(x) = ft (a) + J* g t {x)dx. 

(105) 

From this and equations (100) and (103), 


lim f t {x) = F(a) + / G(x) dx. 

i Ja 

(106) 

Thus the limit on the left exists and equals F (a) for x = a. 
limit F(x). Then: 

We call this 

F(x) = F(a) + J" G(x) dx. 

(107) 


It follows from this that the function F{x) has a derivative and 
F'{x) — G(x), so that the derivative of the limit exists and equals the 
limit of the derivative, under the conditions stated. 

We note that the condition (100) is necessary, as the example 

x 2 

f t (x) — l H—> where t—* «, (108) 

it 

shows. Here 

9 t(x) - ^f t (x) = j, (109) 

so that in any bounded range for x, e.g., 0 g a; 1, g t (x) is continuous 
and converges uniformly to the limit 0. However, there is no limit 
function F(x) of which this is the derivative, since for every value of x, 
the sequence /*(*) fails to converge as t -» », 
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Corresponding to a series of functions 2each of which is differ¬ 
entiable, we may form a series J^d/dx u k (x) f or which we refer 

to as the differentiated series, or series obtained by termwise differentia¬ 
tion. We may apply the preceding considerations to an infinite series 
and obtain the theorem: 

An infinite series of functions , each having a continuous derivative , may 
be differentiated termwise to give a new series which converges to the deriva¬ 
tive of the sum function of the original series , provided that the original 
series converges at some particular point of the interval a ^ x g & and 
provided that the differentiated series converges uniformly in z for this 
interval 

These last conditions insure that the original series converges, so that 
there is a sum function and that this sum function has a derivative. 


We may apply similar considerations to an improper integral of either 
kind. For the first kind, the theorem is: 


If the improper integral 



(HO) 


converges at some particular point of the interval a ^ x S b and the deriva¬ 
tive d/dxg(u,x) is continuous in the two variables for a g x 6 and 
u > r, and such that the improper integral 

r* 3 

J du (m) 


converges uniformly in x for a jg x ^ b y then the integral (110) converges 
for all values of x in the interval and for x in this interval has a derivative 
with respect to x given by the integral (111). 

The interchange of the operation of differentiation and some limit 
process may sometimes be justified by establishing the corresponding 
result for integration by the theorems of section 247, or that given later 
in sections 251 and 253, 

249* Convergence in the Mean* A sequence of functions ft(x), is 
said to converge in the mean to a function F(x) over the interval a, b if the 
integral of the square of the error: 

E t = £\F(x) -f t (x)\ 2 dx (112) 

approaches zero as <—*<». Since the integrand is always positive or 
zero, if |f , (*) — /<(z)| > M over one or more subintervals of total length 
L, or a set of content L, 


E t > M a L. 


( 113 ) 
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Thus E t can not be <e if |F(x) — / t (x) | > fcona set of content exceed¬ 
ing e/k 2 . This shows that a restriction on Et implies a restriction on the 
size of |F(x) — f t (x )| in the sense of some average, or mean. 

If |F(x) — f t (x )| < e throughout the interval, we have 

E t < e 2 \b - a\, (114) 


and it follows from this that if the sequence of functions/ ( (x) converges 
to F(x) uniformly, then it also converges in the mean over any finite 
interval a,b. However the sequence may converge in the mean without 
converging at any point. To form an example, let us arrange the closed 
intervals 


o>$; oi; ; f,i;0>i; 


(115) 


in order and designate the nth interval by Then define a discrete 
sequence of functions/„ (x) by 

f n (x) = 1 for x in /„(x) = 0 for x not in (116) 


For this sequence of functions, we find: 


/ 


|0 — /n(x )| 2 dx = length I n . 


(117) 


As this approaches zero when n —» «, the sequence converges in the 
mean to F(x) = 0 on the interval 0,1. However, the sequence does not 
converge for any value of x in this interval, since for any given x, say x 0 , 
there are functions/„(x) with n arbitrarily large for which f„(x 0 ) = 0, 
and also other values of n arbitrarily large for which/„ (xo) = J. 

The importance of the notion of convergence in the mean is due to the 
fact that certain processes of integration, when applied to sequences 
convergent in the mean, lead to sequences which actually converge to a 
limit in the fundamental sense. To develop this, we shall need an 
inequality, to which we proceed. 

260. The Schwarz Inequality. Let /(x) and g(x) be real functions 
whose product and squares are integrable on the interval a,b. Then for 
the repeated integral 


s: 


dx 


r b m 

f(y) 

L g(x) 

g(.y) 


dy, 


( 118 ) 


we find by expanding the square, reducing the terms to products of single 
integrals, and changing the dummy variable y to x, 

I ** 2 j* [f(x)] 2 dx J lg(z)] 2 dx - 2^ j* f(x)g(x) dx J . (119) 
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Since the integrand in the first form of I, (118) is a square, the value of I 
is positive or zero. Thus we find from the second form of I, (119), 
that: 



f(x)g(x) dx 


^f\f(x)] 2 dx J b [g(x)) 2 dx, 


( 120 ) 


which is the Schwarz inequality. It states that the square of the inte¬ 
gral of the product of two functions does not exceed the product of the 
integrals of their squares. 

261. Integration and Convergence in the Mean. We shall make use 
of the Schwarz inequality in proving that, if the sequence f t (x) converges 
in the mean to F(x ), if gt{x) converges in the mean to G(x) over the 
interval a,b, and if certain integrals exist, then 


lim / f t (x)gt{x) dx 

t 



( 121 ) 


We begin by applying the Schwarz inequality, (120), to the functions 
[F(x) — ft(x)] and G(x). We have: 

[F(x> -ft(x)) 2 dx f[G(x)] 2 dx, 

( 122 ) 

if these integrals exist. The existence of the first integral on the right 
is implied by the convergence in the mean of f t (x) to F(x ). The second 
exists if we make the further assumption that the integrals converge in 
the mean to functions F(x) and G(x) each having integrable squares. 
If the integral on the left exists as a proper integral when a finite number 
of intervals, each of which may be taken arbitrarily small, are removed 
from the range, as we shall assume, the integral of the left then exists 
as an improper integral because of the domination given by the inequality 
(122) for the modified range. 

We now note that in the right member of the relation (122), the second 
factor does not change with t , while the first factor approaches zero as t 
runs through its sequence. It follows that the same is true of the left 
member, since this is necessarily positive or zero. This shows that, if 
the integral on the right exists: 

lim f b f t (x)G(x)dx - f F(x)G(x)dx. (123) 

t J a Ja 

This is the important special case of equation (121) in which all the 
g t (x) are identically equal to G(x). We may reverse the roles of F(x) 


[X 


[F(x) -Mx)]G(x) dx 


-|2 r b 

J S X 
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and G(x) and so write: 


Um j* g t (x)F(x) dx = j* F(x)G(x) dx. (124) 

Now apply the inequality (120) to the functions [F(x) — ft(x)] and 
[0(x) - g t (x)]. We have: 


r? [F(x) -f t (x)] 2 dx f b [G(x ) - g t (x)] 2 dx, 


where 


It -j[V«*) -f t (x)][G(x) - g t (x)}dx 
= J F{x)G(x) dx — j* F(x)g t (x) dx — J' G(x)f t (x) dx 


f ft(x)gt(x) dx. (126) 


From the assumed convergence in the mean, we see that, when t runs 
through its sequence, the right member of the relation (125) approaches 
aero. Hence the same is true of the left member, since ^ 0 and we 
may conclude that lim I t = 0. But the second and third terms in the 

right member of equation (126) approach limits given by equations 
(123) and (124), while the first term is independent of t. Consequently, 
the last term must approach a limit, and this limit is given by the 
following: 

li Taj* ft(x)g t (x) dx - £ F(x)G(x) dx. (127) 

This is the result we set out to prove. We have already noticed the 
special case given in equation (123). A further specialization is obtained 
by putting g t (x) * G(x) - 1 , which gives: 


lim I f t (x) dx = / F(x) dx. 

t •/a 


This shows that, if a sequence of functions converges in the mean to a 
limiting function, the sequence of integrals converges to the integral of 
the limiting function. 

From the positive character of the integrand in equation (112), it 
follows that, if a sequence of functions is convergent in the mean to 
F(x) over a,b then it is convergent in the mean over any subinterval. 
Thus we replace the limits a and b by any two values in the closed 
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interval a,b in such equations as (123), (127), and (128). In particular 
we may take the integrals from b to x, where x is any point of the interval, 
and the convergence will be uniform. Most of the results also hold over 
infinite ranges, as a ,« or — «>,«. However, for such ranges uniform 
convergence does not imply convergence in the mean, and we may no 
longer deduce equation (128), since a constant greater than zero is not 
integrable over an infinite range. 

262. Approximation in the Mean. If 


E{f,g) = J \g(x) -f(x)\ 2 dx 


(129) 


does not exceed €, we say that the function /(x) approximates g(x) to 
within c in the mean, for the interval a, b. If we have three functions, 
f(x) approximating g{x) and g(x) approximating h(x) f the following 
inequality exists between the measures of the approximations: 

[E{f,hrf =£ [E(f,g)) 1 + [E(g,h)]\ (130) 

where all the square roots are positive. 

To prove this, put: 

A(x) = | h(x) - p(*)|, B(x) = | g(x) - f(x)\. (131) 

Then, 

\h(x) ~ f(x)\ ^ A(x) + B(x). (132) 


Thus the inequality (130) will follow if we show that 



[A(x) + B(x)] 2 dx 



f\A(x)] 2 dx 


+ 


{J* [B(x)] 2 dx . 

(133) 


for any two functions A (x) and B(x). Since both members are posi¬ 
tive, this will follow from the inequality obtained by squaring both sides. 
When we do this and cancel corresponding terms, our problem is reduced 
to proving: 


2 f A(x)B(x) dx g 2 


{j^[A(*)] 2 d*j J^W)] 2 * 


(134) 


But this follows directly from the Schwarz inequality, so that the rela¬ 
tion (130) is established. 

The result shows that, if g(x) approximates h(x) in the mean to 
within « and if f(x) approximates glx) in the mean to within e, then 
/(x) approximates h(x) in the mean to within it. 
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253. Infinite Series and Mean Convergence. We say that an in¬ 
finite series converges to a sum function in the mean if the sequence of 
partial sums s n (x) converges to a function s(x) in the mean. It follows 
from equation (128) that, if a series converges in the mean to s(x), the 
series obtained by termwise integration converges to the integral of s(x), 
provided the assumptions as to integrability are satisfied. Also from 
equation (123), we see that the series obtained by multiplying each 
term by a function G(x) with integrable square and by integrating term- 
wise converges to the integral of s(x)G(x). 

264. Equi-continuity. Consider a sequence of functions, ft(x). 
Any one of these functions is continuous at a point x 0 if for any positive 
6, there is a 8 such that: 

I ft(x) - / t (x 0 )l < «, if |x “ sol < 5. (135) 

The possible values of 8 will presumably depend on the value of e, the 
value of x, x 0 and the particular value of t which determines the function 
considered. We have already shown that a function continuous at all 
points of a closed interval, say a <> x ^ h, is uniformly continuous on 
this interval. Thus, if we assume each of the functions is continuous on 
the closed interval a, b for each e and t , we may select a 8 independent of x. 

If it is possible to find a 5, for each positive e, which will serve for all 
values of t, that is for all functions of the sequence, we say that the 
sequence of functions is equi-continuous. The property of equi-continu- 
ity is thus continuity not only uniform in the variable x, but also uniform 
for the different functions considered. For one, or a finite number of 
functions each continuous on the closed interval a,b the property is 
automatically satisfied. However, for an infinite number of continuous 
functions it imposes a restriction. We may apply it to any infinite set of 
functions, not necessarily ordered, like those of a sequence, and define: 

A set of functions is equi-continuous for the closed interval a } b if , for any 
positive €, there is a value of 8 € , such that for every function f (x) of the set: 

1/0*0 -/(*<>) I < «, if \x - Zol < «„ (136) 

where x and a?o are any two points of the closed interval. 

An important consequence of equi-continuity is given by the following 
theorem, due to Ascoli: 

From any infinite set of equi-continuous functions , bounded as a set , a 
sub-sequence of functions may be selected which converges to a limiting 
function uniformly on any interval of equi-continuity of the original set. 

To prove this theorem, we consider any enumerable set of points 
everywhere dense on the interval a ^ x ^ 6, that is a set of points which 
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may be ordered r*, 7 * 2 , r 3 , * • • , and such that every point of the interval 
a ;§ x 55 b is a limit point of this set. The points on the interval with 
rational coordinates form one such set. 

Now consider the totality of values of functions of the set at the point 
n. If there is only a finite number of distinct values, we may select an 
infinite subset of functions 

hi(x)> / 12 &O, /«(*), **• (137) 

which all have the same value at r u F(r x ). Otherwise there is an 
infinity of distinct values, in which case there is a greatest limit point, 
since they are all bounded. Accordingly, we may select an infinite 
subset of functions (137) whose values at r x approach a limit, F(r x ). 

In either case, we have a subset of functions, f X k(x), such that: 

lim /u(ri) - F(r x ). (138) 

k—*-cc 

We next consider the totality of values of the functions f X k(x) at the 
point r 2 . By reasoning as we did before, we may select a subset of 
these functions, which we relabel as 

/2l0), f22(x), f 2 3(X), ■ ■ ' (139) 

such that: 

lim f 2k (r 2 ) = F (r 2 ). (140) 

h~~+- oo 

We continue in this way, obtaining an enumerable number of se¬ 
quences f n k(x), such that: 

lim fnk(r n ) = F(r n ), (141) 

k—>oo 

and each sequence f n k(x) is a subset of the preceding sequence 
Finally we consider the diagonal sequence, 

fn(x), / 22 W, fss(x) • • • . (142) 

For any particular value of n, all the terms of this last sequence after 
the nth form a subset of the functions f n k{x). Therefore it follows from 
equation (141) that 

lim f kk (r n ) = F(r n ). (143) 

► 00 

As this is true for all n, it follows that the sequence of functions (142) 
approaches a limit at all the points of the everywhere dense set of num¬ 
bers r n . For simplicity, we drop one subscript and write f k (x) for 
fkk(x) in the sequel. 

Now select any positive number e, and a 8 € for which the condition 
(136) is satisfied for all x in the interval. We may do this since the set of 
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functions is equi-continuous. Next divide the interval a,b into intervals 
each less than 5 t /2. Since the points r„ are everywhere dense, we may 
select one such point in each of these intervals. Let P be the largest 
subscript for any of these points. Then the finite set of points r p , 
with p g P is such that every interval of length 5, anywhere on our 
interval will include at least one point r p . 

Since the sequence/ia( 2 ), or fk(x) is such that: 

lim f k (r p ) = F(r p ), p = 1, 2, • • • P, (144) 

k~+-<X) 


we may select an N such that: 

I fn(r p ) - F(r„)| < €, for n> N, p g P. (145) 

For, we may do this for each sequence and need merely take the largest 
of the P values so obtained. 

Now consider any value of x on the closed interval a, b. It may or 
may not be in the set r n . For some value of p ) p g P, we have: 

\r p - x\ < (146) 

Consequently, from the condition of equi-continuity: 

1/fcOp) ~fk(x) | < e for all k . (147) 

In particular, for any two values n y n ' each greater than N, we have 
from the last relation: 


I fn(r P ) -f n (x) | < e, (148) 

and 

I fn'(r p ) -fAx) I < e. (149) 

But, from the relation (145), 

I fn(r p ) -fn'(r p ) | < 26. (150) 


From the last three relations, we may conclude that 

\fn(x) - fn>(z) | < 46, for n, *! > N. (151) 


This relation shows that, for any x in the interval, the sequence of func¬ 
tions fh(x) approaches a limit for oo. We call this limit F(x). 
Thus: 


lim f k (x) - F(x). (152) 

A— 


Also, since the N of the relation (151) or (145) is independent of x, it 
follows that the convergence is uniform. 

Finally, since the individual functions are continuous, the limit 
function F(x) is continuous, by section 243. This proves the theorem. 
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In place of the condition that the set of functions be bounded, it is 
sufficient to require that the values of the functions at on© point be 
bounded. For, if we select a 6 corresponding to c in the condition of 
equi-continuity, and then select a positive integer n so large that 
\b — a\ < nd , we may divide the interval a,6 into n equal parts by 
points Xi. Then, from 

1/0*0 - /(zt-i)| < c, if x»-i g x £ x iy (153) 

we may deduce that: 

1/0*0 - /(so) I < W€, (154) 

where x is any point of the interval and x 0 is the point at which the values 
of the functions are bounded. Thus: 

l/(*o)l <M. (155) 

But from the last two relations: 

|/(*)| <M + ne, (156) 

so that the functions are bounded at all points. 

Or, we may merely require that the values of the functions at one 
point contain a convergent sequence, since this leads to a subset of 
functions, infinite in number, with values bounded at one point. 

That some condition of this kind in addition to the equi-continuity 
is necessary may be seen from the discrete set of functions f n (x) = n. 
This set is equi-continuous and in fact any positive number will serve as 
a 5 of equi-continuity for all positive values of e. However, no con¬ 
vergent infinite subset can be found. 

266. Tests for Equi-continuity. In section 128 we showed that, if a 
function had a derivative f'(x) at each point of a closed interval, uni¬ 
formly bounded so that: 

If to | g M , (157) 

then, for any two points of the interval, 

IfM -fto)l < M\x 2 Xi\. (158) 

We called the last relation a Lipschitz condition. Such a condition 
implies continuity, and we may take: 

— as a possible value of 5 t , (159) 

M 

in the definition of continuity. 

It follows from this that, if each of a set of functions satisfies a 
Lipschitz condition with the constant the same for all the functions, 
the set of functions is equi-continuous. 
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Also, a set of functions each of which has a derivative, the derivatives 
all admitting the same bound, is necessarily a set of equi-continuous 
functions. 

Under certain restrictions, the set of functions 


/(*) = J K(x,y)g(y ) dy 


(160) 


give rise to a set of equi-continuous functions. In fact, if the function 
K(x,y ) is a fixed function continuous in the two variables x and y for y 
in the closed interval a, b and x in the interval under consideration, and 
if the functions g(y) are uniformly bounded, or at least satisfy the 
condition 

£ \g(y)\ 2 dy <M (161) 


with the same M for all the functions, then the equation (160) defines a 
set of equi-continuous functions. 

To see this, we w r rite: 


fix) - f(x o) = f" [. K(x,y ) - K(x 0l y)] g(y ) dy. 


(162) 


We now apply the Schwarz inequality which gives: 

[fix) - /(So)] 2 ^ J lKix,y) - Kix 0 ,y)) 2 dy £ [giy)} 2 dy. (163) 


From the assumed continuity of K(x,y), it follows that 

\Kix,y) - Kix 0 ,y)\ < t, if |x - x 0 | < 6„ a^y^b, (164) 
so that we may conclude from this and equation (161) that 

[fix) - fix 0 )] 2 ^\b- a\m, if |x - x 0 | < 8,. (165) 


Since e is arbitrary, this proves that the functions fix) are members of an 
equi-continuous set. 

266. Several Variables, Complex Variables. The notion of uniform 
convergence may be extended to functions of more than one variable. 
Thus, a function of several real variables approaches a limit uniformly 
in these variables, on a certain range, if beyond a certain point in the 
sequence, t f independent of the values of these variables, the difference 
between the limit and the approximation is numerically less than t. 
A sequence of continuous functions of several variables, convergent uni¬ 
formly in these variables, has a limiting function continuous in these 
variables. 
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The theorems just mentioned also hold for functions of one or more 
complex variables. 

Similarly the notion of equi-continuity and convergence in the mean 
may be extended to functions of more than one real variable, or to the 
complex case. In extending the idea of convergence in the mean to 
complex values of the function we must replace the squares of the 
differences by squares of the absolute value of the differences to preserve 
the positive nature of the integrand. 

EXERCISES XII 

1 + tx 2 

1. Let/<(x) = —-, andF(x) = lim ftix). Show that the convergence 

l + tX t ~+ oo 

is not uniform in any interval including the origin and that F(x) is not continuous 
at the origin. 

2. Let the nth term of an infinite series be 


Unix) = 


(1 + nx)(l + [n + l]x) 


Show that the sum function s(x) = lim s„(x), where s n (x) = £ Uk(x), is Cha¬ 
ri —►<» & = 1 

continuous at x — 0. Deduce that the convergence is not uniform, and verify 
by studying directly the values of &(x) — s n (x). Hint: First show that 


nw 1+x 1 + (n + l)x 

3. Draw conclusions similar to those of problem 2 if -w n (x) = 


(1 + x) n 


Hint: Here s n (x) = 1 — 


(i + xy 


4 . If Unix) = ;-r-, where in = 2 n , show that the sum function is 


x 1 

--r if |x| < 1 and -; if Ixl > 1, and show directly that the convergence 

1 — x 2 1 — x- 


is non-uniform near x = 1. Hint: Show that s„(x) = 


1 - x 2 1 - x 2w 


5. If ftix) = ■ , Fix) = lim ftix) = 0, and f Fix) dx = 0. Show 

that lim I ftix) dx — w /4, and investigate directly the non-uniformity near 0. 

(—►-f oo J0 

6. If f t (x) = t t sin irtx, 1 It, and / ( (x) = 0, for 0 < (, 1 /< < x g 1, 

show that / F(x) dx = 0, where F{x) = lim f t (x), but that 
J 0 t ► "00 


Fix) dx = 0. Show 


r mx) 

) Jo 


dx * 2. 
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7. Let «»(*) =» 1 for all * such that n = [1 /|x|), the greatest integer contained 
in 1/|*|, and otherwise zero. Show that the series £u„(x) converges to 1 if 
0 < |*| ^ 1, and otherwise to zero. Also show that the convergence is non- 
uniform near zero. 

8. Show that, as t —» + ac, f t (x) — |x| 1/l converges non-uniformly for x near 
zero. 


9. If /,(*) - and F(x) 


J f% 00 

F(x) dx - 0, 

0 


J raoo 

ft(x) dx = 1/2. Also show that the values remain 0 and 1 /2 
o 

if we replace the upper limit <*> by p, any positive number. 

10* Show that as t —► », f t (x) - x/(l + tx) converges to 0 uniformly on the 
interval 0 £ x 1, but that g t (x) ~ 1 /(I + tx) converges to zero, but non- 
uniformly for values near zero. This shows that multiplying in an unbounded 
factor, here 1 /x, may disturb uniformity. 

11* Show that in problem 10, g t (x) converges in the mean to its limit, and 
verify directly that over 0,1 the integral of the limit equals the limit of the 
integral. Also deduce this result from section 247, with zero as the exceptional 
point near which g t (x) is bounded. 

12 * For x and t positive, show that f t (x) = tx( 1 — x) 1 has a single maximum 
for x «= 1/(1 + 1) equal to (1 + 1 so that as t—* «, the maximum 

approaches 1 /e. Deduce that the convergence is non-uniform near zero, but 
that the function is bounded. Hence use section 247 to prove that the integral 
of the limit of / t (x) equals the limit of the integral over the interval 0 to p, any 
positive number not exceeding unity. Also show this by direct calculation. 

IS* The behavior of g t (x) = fix(l — x)* may be deduced from problem 12, 

since it is f/<(x). Show that for this function I lim g t {x) dx = 0, but 

u o t—►» 


lim I g t (x) dx — 1. 

I—► oo v 0 

14. Let g n (x) be a discrete sequence approaching G(x) as n increases through 
integral values and let the g n (x) be uniformly bounded, |g„(x)| < K, Then if 


Jn(x) * £ —. g P {p ! x) } F{x) = lim / n (x) exists. Show that the convergence 
J>«»1 P * !»-*►<» 

will be uniform if g n (x) G(x) uniformly for all values of x. 

18* Let h n (x) be a sequence of functions, 0 < h»(x) < K, and converging to 
H(x) for-l£x£ 1. Let H( 0) * 1, and H(x) - 0 for 0< |x| g 1. Show 
that if we put g n (x) = h n (sin tx) the sequence /»(x) defined in problem 14 will 
converge non-uniformly near every rational value and hence in every interval. 

n 1 

A simple example is A»(x) ■* (1 — x 2 ) n , / n (x) « £ —; eos 2n (n! tx ). 

pm\ n I 

16. The aeries with u„(x) = (—l)"/n converges uniformly, since the terms 
are independent of x. Show that it is not dominated by any convergent series 
of positive terms and so the uniformity can not be proved by the Weierstrass 
Af-test. 
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17. Draw conclusions similar to those of problem Id for the uniformly con¬ 
vergent series with u n (x) « 1 /x if 1 /(n + 1) ^ I lx £ 1 /», and u n (x) « 0 for 
other values of x. 

18. Let u n {x) be the general term of a series proved to be uniformly con¬ 
vergent by the Weierstrass ilf-test. Show that if v n (x) form a set of uniformly 
bounded functions, \v n (x)\ < K , then the series v n (x)u n (x) converges absolutely 
and uniformly. An example is u n (x) » 1 /(n 2 + x 2 ), v n (x) = sin nx. 

19. Show that we may replace the condition on v n (x) in problem 18 by the 
condition that v n (x) approaches a finite limit, uniformly in x, as n increases 
through integral values. An example is u n {x) = 1 /(n 2 + x 2 ), v n (x) = 
x 2n /(I — x 2n ), for the range x ^ 1 + P, or the range |xj <1 — p, where p is any 
positive number less than one. 

20. If for each fixed x, v n {x) decreases as n increases and approaches zero 
uniformly in x, while for all values of n and x under consideration the sums 


n 

u n (x) are numerically less than some fixed number K , the series with general 


term v n (x)u n (x) converges uniformly. An example is v n (x) 


1 


n + x 2 


, Unix) 


sin nx. Hint: Use section 199. 

21. Show that the series with u n {x) = 


(-l)n x 2n 
n 1 — r 2n 


converges uniformly in 


any closed interval not including 1 or — 1. Hint: Use problem 20. 

22 . In problem 29 of Exercises IV, the expansion of (1 + x) m in a power series 
C n x n was obtained, for |x| < 1. In section 195 we showed that this expan- 

n =*0 

sion converged for x = —1, if m > 0, and had all the terms of the same sign 
after a certain point. Show that the series converges uniformly for |x| 5* 1, 
and, since it represents a continuous function in this closed interval, must equal 
(1 + x) m for x = 1, or —1. 

23 . Prove that |x| = £ 1/2 C n a l “ 2n (a 2 — x 2 ) n for —a Sj» x ^ a, the series 

T **»0 

of polynomials being uniformly convergent in this interval. Hint: Put |x| = 

x 2 \T 2 

1 ~ a 2 / an( ^ USe P ro ^ em 22 * 

24 . A continuous function made up of a finite number of linear segments, or a 
polygonal line, may be expressed as the sum of a linear function and a number of 
functions of the form A\x — xq|, one for each vertex. Also on a finite closed 
interval any continuous function may be uniformly approximated by a polygo¬ 
nal function. From these facts, and problem 23, deduce that the continuous 
function may be uniformly approximated to within any preassigned degree by a 
polynomial. The theorem is due to Weierstrass, the method of proof here 
suggested is due to Lebesgue. 

25. Let the sequence /<(x) converge to G(x) at all points of a closed interval 
and converge in the mean to F(x), on the same interval. Prove that if F(x) and 
<?(x) are continuous, F(x) = (?(x). 
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26. Let the sequence of functions f t (x) converge in the mean to F(x) on a closed 
interval on which F(x) is continuous. Prove that if the functions f t (x) form 
an equi-continuous set and any subset is selected which converges at all points 
of the interval, the limit of this subset will be F(x). Hint: Use problem 25. 

27. In the open rectangle a < x < b, c < y < d, let G(x } y) be continuous and 
G(x } y) = d 2 F /dx dy. Show that, if the repeated limits exist, 

r 

F(x } y) dx = lim lim H(x h y h x 2) \ 

V \—►c Lxi-^a 
l/3-+d x 2 -+b 

where H{x h y h x 2) y 2 ) = F{x 2l y 2 ) - F(x 2 ,yi) - F(x h y 2 ) + F(x h yi). This 
enables us to construct improper repeated integrals whose value depends on 
the order of integration. Examples are: F(x,y) = (x — y) f(x + y), G(x f y) — 
2(x — y) /(x + y) z or F(x,y) = tan -1 (y/x), G(x,y) = (y 2 — x 2 ) /(x 2 y 2 ) 2 with b 
and d positive and a and c either both zero, or both oo. 

28. If for each fixed x , p(u,x) decreases as u increases to co and approaches 


f dy f b 

t/ c t/a 


2 , 2 / 2 ) J > 


zero 


uniformly in x, for a g x ^ b, while J 


f(u,x) du 


< M for all positive 


J f* 00 

p(u,x)f(u } x) du converges uniformly 
0 

in x for a S % ^ b. Hint: See problem 29 of Exercises IX. 

29. If a > 0, 6 > 0 , and g'(x) is continuous and integrable from 0 to 00 so that 

r 

Jo 


g'(x) dx = 0 (+o°) — 0 ( 0 ), prove that: 
g(bx 0 - g(ax) 


r 


dx = [g(+° 0 ) - 0 (O)] log - • 

CL 


(Elliott.) 


Hint: Show that 

*b 


J r* oo 

g'(ux) dx converges uniformly for a ^ u ^ 6 , and invert 
0 

/»oo 

' du I g'iux) dx. As examples, 

a Jo 

,oc tan " -1 bx — tan -1 ax 


r 

Jo 


7T 

dx = ~ log 


f 

Cl Jo 


'oo e ~bx _ e~ ax 


dx — log: 


30. If a > 0, b > 0 show that the order may be inverted in 

J r*oo pa 

dx I e~ JUX+tbx dii, and deduce that: 

0 Jo 


and 


31. Show that 


x 

J ntao 

0 

r- 


00 (1_- e 

(1 


cos bx 1 a 2 + b 2 
- dx = -log— 

,b 

tan 1 - * 
a 


x 

> —ax\ 


e" w ) sin bx t 

- dx = ~~ 

x 2 


fo £ 

Hint; For the first case, take the limit as a 


Sm hX dx = ~ if 5 > 0 , 0 if b = 0 , and — ~ if 6 < 0 . 
2 ^ 


+ 00 of the last integral of prob- 
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lem 30, noting that the term in the integral involving e~°® is dominated by 

poo i 

I dx «= - . For the last case, put x = — u. 


J r**/2 poo poo pco 

dd I e~ r2 r dr = / dx I dy, and deduce that 

o t/O t/O J o 

X " ! Vff 

e x dx — . Hint: If we call the first integral with upper limit <*> 

replaced by R, Ir, a direct calculation shows that Ir increases with R and ap¬ 
proaches ir/ 4. If the second double integral, with both upper limits <» replaced 
by a is J a , the positive nature of the integrand shows that J a increases with a, 
and I a < J a < hat so that the second double integral converges and to the same 
value as the first. 

J r° e“ 2a \Ztt 

e ** dx = ---. Hint: Either show that if 1(a) 

o 1 

is the integral, I'(a) — —21 (a); or replace the integral from 0 to oo by that from 
0 to a plus that from a to oo. Then put x — 1 /u in one integral, and take 
x — a lx as a new variable. In either procedure the result of problem 32 must 
be used. 


34 . Show that 


dx = a ~. Hint: Either integrate by parts, or 
2 


differentiate the integral with respect to a, and use problem 31. 

f(u) 

- du converges and f(u) has a derivative at u ~ 0, 

l u 

J r 00 f(bx) — f(ax) a 

- dx = /(0) log r . (Frullani.) Hint: Deduce 

o x b 


* 9 f(u) -m 


(ax) — /(0) 


and hence 


^f(bx) — f(ax) 


du - /(0) 


36 . Illustrate problem 35 for f(u) = e~ u , sin u, cos u, and compare the results 
with those of problems 29, 31, and 30. 

37 . Assuming that g(u) — g( oo) — f(u) satisfies the conditions imposed on 
f(u) in problem 35, deduce the equation of problem 29. Show that tan -1 u 
satisfies these alternative conditions. 

38 . Deduce the Schwarz inequality from the fact that the quadratic expres¬ 
sion in u f J* [f(x) — u g(x)] 2 dx, cannot change sign. Compare the proof of 
the inequality for sums in the hint to problem 9, Exercises X. 
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FUNCTIONS OF COMPLEX VARIABLES 

So far we have only applied the processes of differentiation and inte¬ 
gration to functions of a complex variable built up from elementary 
functions. We now wish to consider the more general functions of a 
complex variable to which these operations can be applied. Such func¬ 
tions are connected with transformations of the plane which preserve 
angles and are also coextensive with the class of functions which have 
power series developments. We call them analytic functions and 
develop several of their characteristic properties. We illustrate their 
use in evaluating certain real, definite integrals, 

A number of processes are described which, when applied to analytic 
functions, lead to new analytic functions. Finally we briefly indicate 
how some of the theorems may be extended to analytic functions of 
several complex variables. 

257. Functions. We have already applied the notion of functional 
dependence to complex values of the variable in section 101. Let us 
again consider two complex variables, or variable complex numbers, 
z = x + iy and w = u + iv, with w a function of z. We shall usually 
take as the range of values of z some two-dimensional region of the plane, 
for example a circle or a rectangle, in which the function is single-valued. 

Thus, each value of z, or ( x,y ) in the region R mil determine a single 
value of Wj or ( u,v ), 


w = f(z) = u(x,y) + iv (x,y). (1) 

Each such function leads to two real, single-valued functions of two 
real variables, u(x,y) and v(x,y). Conversely each ordered pair of real 
functions of this type may be used to define a single-valued function of 
one complex variable. 

The function/(z) is continuous for the value z 0 , if 

lim f(z) = f (zq) y (2) 

z —►Zo 

where as in section 102 the limit must exist as a two-dimensional limit 
of the kind discussed in section 242. Thus, in particular, the limit must 
equal f(zo) for every discrete or continuous sequence of values z t —» z 0 . 

422 
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As pointed out in section 102, an equivalent condition for continuity at 
Zq is that there is a number S € for each positive number e such that: 


l/(*) - /(zo)| < €, if \z - z Q \ < (3) 


Also, the function/(z) is continuous at z 0 = a; 0 + iy 0 if, and only if, the 
two real functions u(x,y) and v(x,y) are each continuous at (x 0f y 0 ). 

258. Derivatives. We recall the definition of the derivative of f{z) 
given in section 110, namely, 



A w 
lim —- > 

Az-+0 A z 


(4) 


provided the limit exists as a two-dimensional limit. 

Let us investigate the conditions that this imposes on u and v. 
have: 

A w _ Au + i Av 
A z Ax + i Ay 


We 

(5) 


If the limit exists as a two-dimensional limit, it will exist for any sequence 
of values of A z —> 0. In particular, we may take Ay = 0, and Ax —> 0 
and conclude from equations (4) and (5) that: 


dw du . dv 
dz dx dx 


( 6 ) 


where the existence of the limits on the right follows from the existence 
of that on the left by section 99. 

Similarly, we may take Ax = 0, and Ay —> 0, and deduce that: 


dw 

dz 


. du dv 

i -1-- 

dy dy 


(7) 


As u and v and hence their partial derivatives are real, the last two 
equations imply that: 

du dv _ du dv /n . 

— = — and — = — ■— (8) 

dx dy dy dx 

These are known as the Cauchy-Riemann differential equations. It 
follows from our discussion that: 

A necessary condition for w = u + iv — f{z) to have a derivative at 
z 0 = x 0 -f iy 0 is that the functions u(x,y) and v(x,y) have first partial 
derivatives far (xo,2/o) which satisfy the Cauchy •‘Riemann differential 
equations (8). 
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There are no farther conditions of this kind imposed on the values of 
the partial derivatives of u and v at the point in question. In fact, we 
shall prove that: 

If u(x,y) and v(x,y) have partial derivatives which are continuous at 
(> 0 , 2 / 0 ) and satisfy the Cauchy-Riemann differential equations, (8) far 
(*o4/o), then the function f(z) = u + tv has a derivative f'(z ) at 
Zo - Xo + iyo- 

By section 211, the conditions on u and v make them differentiable in 
x and y at xo,yo, so that: 

du du 

Au = —- Ax + — Ay + ti Ax + t 2 Ay, (9) 


and 


Av 


— Ax + — Ay + « 3 Ax + e 4 Ay, 
ox cry 


where all the € approach zero with Ax and A y, or with A z. 
It follows from the equations (8), (9), and (10) that: 


Au + i Av 
where 

Consequently, 


( du dv\ . ,, 

— + i —J (Ax + i Ay) + e Ax + e Ay, 

t = ci + it 3, and t n — C2 + it 4. 

Aw du . dv t Ax n Ay 

- sb- \~ % - \- e - \- e - 

A z dx dx A z A z 


( 10 ) 


( 11 ) 

( 12 ) 

(13) 


Since |Ax| ^ |Az| and |Ay| g |Az|, 
|A®| 


A z 


g 1 and 


Ay 
Az 


<, 1 . 


(14) 


From this and the expression for the « in equation (12), the 
terms in equation (13) are seen to approach zero with Az, so that 

Aw du . dv 
hm — = — + i — » 
j-»o Az dx dx 


last two 
(15) 


and the function w — f(z) has a derivative at zq. 

The added condition of continuity, or some condition to insure that 
u and v are differentiable is necessary, as the following example shows: 

u(x,y) * xy, v(x,y) = 0. (16) 

For {*#) m (0,0) each of these functions has both partial derivatives 
equal to aero, so that equations (8) are satisfied. However, the first 

>Y 
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function is not differentiable. The function f(z) - u + tv has no 
derivative at the origin. For, 


if At =* Ax + im 2 Ax, 



m 

1 + im 2 


(17) 


which varies with m, so that the two-dimensional limit does not exist. 

259. Conformal Transformations. If we represent the values of z in 
one plane with x and y coordinate axes and the corresponding values of 
w in a second plane with u and v coordinate axes, we may interpret the 
relation w = f(z) as a transformation of the points in some region R of 
the first plane into certain other points of the w plane. Let us assume 
that the function u(x,y) and v{x,y) have partial derivatives, continuous 
at some particular point x 0 ,yo under consideration. Let us also assume 
that the Jacobian 


d(w,y) 

d{x,y) 


du 

du 

dx 

dy 

dv 

dv 

dx 

dy 


(18) 


at this point x 0 ,yo. Then, if Uo,v 0 is the point into which x 0 ,y 0 is trans¬ 
formed, by section 218 there is some two-dimensional neighborhood of 
u 0 ,v 0 in which the equations 

u = u(x,y), v = v(x,y) (19) 

have a solution of the form 

x = x(u,v), y = y(u,v). (20) 

These functions will have partial derivatives continuous at wo,»o, and 
by problem 19 of Exercises X, such that: 


d(s,y) = 1 0 

d(u,v ) d(u,v) 

d(x,y) 


( 21 ) 


Any curve in the xy plane passing through the point Xo,yo and having 
a tangent at that point with direction components 


dx , 

- and y 


dy 

dt 


(22) 
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will be transformed, at least for some arc including into a curve in 
the uv plane, passing through the point u 0 ,v 0 and having a tangent at 
that point with direction components 

u = ~7* = UxX + u vV > (23) 


, dv . . 

v = = v x x + v v y , 


by the equations (19). Conversely, any curve in the second plane, with 
a tangent at u 0 ,v 0 in the direction given by equations (23) will have 
some arc transformed by the inverse transformation ( 20 ) into an arc 
through xo,yo with the direction given by equations ( 22 ). 

As in section 175, we have for the arc length in the uv plane 

s' 2 = u' 2 + t/ 2 

= ( u x + v x )x' 2 + 2 (u x u y + VxVy)x'y r + (u 2 y + v 2 )y r2 . (24) 

The equations (23) suggest the transformation: 

U — U X X + UyY y V = V X X + VyY y (25) 

from an XY plane to a UV plane, where the coefficients are constants, 
equal to the value of the partial derivatives at Xo,y 0 for the functions of 
equation (19). If 

X = x - xo and Y = y - y 0 , (26) 

it follows from the differentiability of the functions that 

u — Uq = U + *iX + € 2 Y and v — vq = V e^X -f- 64 K, (27) 

where, as in equations (9) and (10), all the e approach zero with X and 

F. Hence, for points near xo,yo the transformation given by equations 
(19) may be approximated by putting 

u — Uq = U and v — v 0 = V, (28) 

and combining equations (25), (26) and (28) to obtain the relation 
between x,y and UyV. Since the last two of these equations merely 
change the origin to the points under consideration, the character of the 
approximating transformation is given by equations (25). These 
represent an affine transformation, which takes parallel straight lines 
into parallel straight lines. Equally spaced points on any one line in 
one plane go into equally spaced points on some line in the second plane. 
However, while the scale factor is the same for any two parallel lines, it 
will legally differ for different directions. In fact, a circle in either 
plane will go into an ellipse in the other plane, and the transformation 
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may be generated by a combination of a rotation and two changes of 
scale, usually different, along a certain pair of perpendicular axes — the 
axes which are transformed into the principal axes of the ellipse. 

When the two changes of scale are equal, the transformation reduces to 
a similarity transformation, which may be generated by a combination 
of a rotation about the origin and an expansion out from the origin or by 
the same change of scale in all directions. In this case all lengths are 
changed in the same ratio, and all angles are preserved. The imposing 
of either of these properties on the affine transformation makes it a 
similarity transformation. In fact, if we merely require all pairs of 
perpendicular lines in one plane to go into perpendicular lines, the ellipse 
which is the image of a circle must have all its pairs of conjugate axes 
perpendicular and therefore must reduce to a circle, so that the trans¬ 
formation reduces to a similarity transformation. 

When the approximate transformation given by equation (25) is a 
similarity transformation, the transformation given by equation (19) is 
said to be conformal, or to preserve angles, at the point in question. 
Since the equations for directions obtained from equations (25) are 
identical with equations (23), it follows that in this case, two curves in 
the uv plane intersecting at u 0 v 0 cut at the same angle as the curves in 
the xy plane of which they are the images. 

To find the condition for a transformation to be conformal, we note 
that the circle 

U 2 + V 2 =* i (29) 

is transformed by the equations (25) into 

(ul + v 2 )X 2 + 2(u x u y + v x v y )XY + (ti* + vl)Y 2 = 1. (30) 

This will reduce to the equation of a circle if, and only if, 

WjWy “I” t) X Vy — 0, (31) 

and 

u x + v x = u y + Vy. (32) 

Since we have assumed that the Jacobian of equation (18) is not zero, 
v x and v v cannot both be zero. Suppose v v 9* 0, and put 

u x = kv v . (33) 

Then, from equation (31), we find: 

v x = — ku y . (34) 

It follows from the last two equations that: 

Ul + Vl = k 2 {U 2 y + V 2 y). 


(35) 
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A comparison of this equation and equation (32) shows that fc 2 «= 1. 
Thus, either 

U x = Vy, Uy = ~V X , (36) 

or = Uy ~ v x . (37) 

Either of these pairs of equations imply equations (31) and (32). 

If a transformation satisfies equations (36) its Jacobian 

u x Vy - UyV x = u 2 + u 2 > 0. (38) 

But for a transformation satisfying equations (37) its Jacobian 

u x Vy — UyV x - — ul — u 2 < 0. (39) 

The discussion of section 233 shows that in the first case orientation is 
preserved, while in the second case orientation is reversed. In fact, if 
we interchange u and v, which reverses sense, the equations (37) reduce 
to (36). 

As the equations (36) are the Cauchy-Riemann differential equations 
0), we may summarize our results as follows: 

A transformation given by two functions u = u{x,y) and v = v{x,y) 
with partial derivatives continuous at a point and Jacobian different from 
zero at the point preserves angles as to magnitude and sense at the point if, 
and only if, the Cauchy-Riemann differential equations (36) are satisfied. 

By the preceding section, under these conditions the function 
w(z) = u + iv has a derivative given by equation (15), 

dw 

or — = u x + iv x . (40) 


Prom this and equations (36), 


dw 

dz 


= ul + v\ — U X Vy — V X Uy - 


d(u, v) 
d(x,y) 


(41) 


This shows that the derivative is not zero. In fact, from equations 
(24), (36) and (41) we find: 


u' 2 + t/ 2 = 


dw 2 

dz 


(x' 2 + y' 2 ). 


(42) 


This shows that the numerical value of the derivative is the factor by 
which the differential of length is multiplied by the transformation. 
This was to be anticipated from equation (41), which shows that its 
square is the Jacobian or factor by which the differential of area is 
multiplied, together with the fact that for differentials the transformation 
has the character of a similarity transformation. 
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Some of these facts could be derived otherwise by noting that y when 
there is a derivative: 


lim 


\Aw\ 

|Az| 


dw 

dz 


(43) 


Also, if the derivative is not zero its argument is determined to within a 
multiple of 2ir, by section 96, and for a suitable branch 


r Aw dw 

lim arg — = arg — • (44) 

A z dz 


That all differential lengths are multiplied by the same factor follows 
from equation (43), while equation (44) shows that the angle between 
any direction and its transformed direction is the same, so that angles 
are preserved as to magnitude and sense. Hence: 

At any point where the function w(z) has a derivative dw/dz distinct 
from zero , the corresponding transformation preserves angles as to magnitude 
and sense and has a positive Jacobian. 

260. Power Series. We have seen in section 112 that for a suitably 
restricted range of the complex variable z, any elementary function has 
a derivative. We wish to show now that a more general class of func¬ 
tions of a complex variable which have derivatives, is the class of func¬ 
tions expressible by power series. For this reason we shall consider 
power series expansions in some detail. 

A power series in z is an infinite series whose terms are products of 
integral powers of z by complex constants: 

£ a n z*. (45) 

n=0 

We may also consider power series in z — c, of the form 

£ a n (z - c) n . (46) 

n-0 

As these may be reduced to the first form by putting 

Z = z - c, (47) 

most of their properties follow at once from the simpler form, and we 
shall chiefly confine our attention to this first form (45). 

Power series form a natural generalization of polynomials, which are 
finite sums of similar terms. A power series may converge for all 
values of z, as 



(48) 
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Or a power series may diverge for all values of z except z = 0, as 

22^ ! s n . (49) 

Also a power series may converge for some values and diverge for 
others, as 

Lz n . (50) 


These properties of the examples follow from the test-ratio, which is 
z/n, nz, z , respectively. Thus we have convergence, when these 
approach a limit numerically less than one, or for all z in the first case, 
and for \z\ < 1 in the third. Similarly we have divergence, when these 
approach a limit numerically exceeding one, or for all z distinct from zero 
in the second case and for \z\ > 1 in the third. 

261, Circle of Convergence. We generally omit from consideration, 
series which converge only for z = 0, as being without interest. For 
series not of this type, considerable information about the points for 
which they convergai^gven by the following theorem: 

If a power series in z conver^^for^some^jjalue of z } say Zi 0 , then it 
converges absolutely for all values of z with \z\ < \zi\, and in fact uniformly 
in any range \z\ S r , where 0 < r < \z\\. 

From the assumed convergence of the series, |a n Zi| —> 0, and so is 
less than unity for all terms after a certain one, say the Nth. Hence if 
M is the maximum of the finite set of numbers 1, \a v z\\ for p = 0, 1, 2, • • •, 
N, we shall have for all n, 

M\ S M. (51) 

For any \z\ < \zi\, we may find a positive number r such that: 


\z\ < r < \zi\. 


If we then put: 


c = 


w 


c < 1. 


Hence, for the value of z under consideration, 

|z 


|a n z n | = |a„Zj| 


Zl 


g Mc n . 


(52) 

(53) 


(54) 


But since c is less than unity, Mc n is the nth term of a convergent geo¬ 
metric series. Thus, by the Weierstrass M-test of sections 245 and 256, 
the nnffiyrm convergence of "Z^a n z n in the range |z| ^ r follows. The 
absoluteconvergence of the series for the z considered, also follows. 

Tibe range \z\ % r is the interior and boundary of a circle, with center 
at tbe origin. We shall refer to such a circle as a circle of uniform con- 
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vergence. The theorem just proved shows that, if a series converges for 
any value not zero, there are such circles. 

Recalling sections 243 and 256, and the continuity of the powers of z , 
we see that the sum of a power series f(z) is a continuous function of z 
at all points inside or on any circle of uniform convergence. 

Suppose that a power series converges for z x , where |z x | = r x , and 
diverges for z 2 , where |z 2 | = r 2 . Then, by the theorem just proved, it 
will converge for all z with \z\ < r x . Similarly, it will diverge for all z 
with \z\ > r 2 , since the convergence for any such value would imply that 
for z 2 , contrary to our assumption. This leads to a separation of values 
of r into two classes, one containing values of r x such that the series 
converges for all z with \z\ = r x and the other class containing values of 
r 2 such that the series diverges for some z with \z\ = r 2 . All the con¬ 
ditions of section 6 are satisfied and there is a number R such that the 
series converges for all z with |z| < R , and diverges for all z with \z\ > R . 
For \z\ = R itself the series may converge or diverge. The circle 
\z\ = R is called the circle of convergence of the series. The number R is 
called the radius of convergence of the series. It follows that unless the 
series converges for no values except z = 0, when we put R = 0, or 
converges for all values of z , when we put R = ° o, there is a finite radius 
of convergence. By V of section 193 and section 204, 

1 _ l -1 

— = lim |a n | n or R = lim |a n | n . (55) 

R 


For each of the series 


00 


Z 



(56) 


we have R — 1. For the first, we have divergence at all points of the 
circle of convergence. For the second we have convergence at all points 
of the circle of convergence. For the third we have divergence for 
z = 1 and convergence at all other points, by the Abel test of section 199. 

262. Differentiation of Power Series. We shall now prove that: 

For all values of z inside the circle of convergence of a power series , the 
function represented by the series has a derivative , whose value is given by 
the series obtained by termwise differentiation . 

To prove this, consider a point z inside the circle of convergence, 
so that if \z\ = r, r < R. Select a positive number p such that 
r + p < n < R. Then the circle with radius r x will be a circle of uni¬ 
form convergence. Hence, in particular, 


2> n r n and £ a n {r + p) n 


(57) 
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each converge, so that the series obtained by termwise subtraction 
likewise converges. Its general term is: 


On' 


(r + p)” - r" 
P 


a n 


(nr n ~ 


* + 


n(n 


J 1 „n~2. 


2 1 


'V + 


> 


(58) 


The second form shows that it is positive and decreases if p is replaced 
by any smaller number. 

Now let h be any complex number with \h\ < p, and form the series 
for the difference quotient, 


The general term is: 


/(z + h) - /(z) 
h 


(59) 


(z + h) n - z' 


- — a n (^nz n 1 


+ 2 ! 


~ 2 h + 


(60) 


The numerical value of this is less than the term on the right of equation 
(58), which was the term of a convergent series of positive terms inde¬ 
pendent of h . Hence, by the Weierstrass Af-test the series with this as 
its general term converges uniformly in the complex variable h , for 
\h\ < p. The terms are continuous functions of z for these values of h , 
so that the limiting function is continuous, and 


lim 

h-+0 


f(z + h) -f(z) 
h 


00 


22 na n z n \ 

7l*=l 


(61) 


the value of the series for h — 0. 

Thus/(z) has a derivative, and 

/'(z) = £ na n z”~\ (62) 

» = 1 

the series obtained by termwise differentiation. 

By equation (55), the radius of convergence of the derived series, 
Bd, is given by: 

1 — - 

— = lim |na„|". (63) 

til) n—►» 

But lim » l/n = 1, so that the upper limit is unchanged if we omit this 
factor and B D = R. Thus the derived series has the same radius of 
convergence as the original series. 

Hence we may repeat the process any number of times and 

r, /* w (z) =■ £ n(n — 1) • • • (n — k + l)a„z n ~*. 

n»fc 


(64) 
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263. Integrals. If we wish to define the integral of a continuous 
function of a complex variable/(z) from z to z", we first specify a path, 
or curve, C in the z plane joining the points representing z f and z". 
We must take this path in the region of definition of /(z) and shall usually 
take it as given by two equations 

x = x(t), y = y(t), (65) 

where each of these functions is continuous and of bounded variation. 
Thus the curve will have a finite arc length. 

We then form a sequence of points on the path, corresponding to a 
subdivision of the t interval which corresponds to the arc: 

t' = /o < <i < <2 < • • • < in = (66) 



n 

Z f(z k ) AZkt where A z k = z k - z k _ x . (70) 

k = l 


We may decompose this into a combination of sums of real terms by 
writing: 

z = x + iy ) Az = Ax + i Ay y f(z) = u + tv, (71) 

so that: 

f(z) Az = (u + w) (Ax + i Ay) 

= (u Ax — t> Ay) + t( w Ay + v Ax). (72) 

Thus the sum (70) may be reduced to 

n 

Z [«(£*,y*) a** - ffoJ*) ^2/*] 

1 n 

+ *' I [«(z*,y*) Ay* + v(x k ,y k ) A®*]. (73) 

fc«l 

Each of the terms in brackets is the typical term of the sum for a line 
integral, as defined in section 180. Consequently, when 


6m 353 max \Azk\ 35 max VAx* + Ayl —> 0, 


(74) 
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these sums each approach line integrals along the path C } and we have 

lim £ f(zk) A z k = f u dx — v dy + i f u dy + v dx. (75) 

We call this limit the integral of f(z) along the path C and write 

J f(z) dz = / u dx — v dy + i I u dy + v dx. (76) 

c Jo J c 

The form on the right is easily recalled by formally separating 

J(z) dz = (u + iv) (dx + i dy). (77) 


264. Integral of a Derivative. If there is a function F(z), which in 
some region including the curve C, has a continuous derivative F'(z) 
which equals/(z), then by equations (6) and (7) of section 258, 


if 

F(z) = U(x,y) + iV{x,y), 

(78) 


F'(z ) = 17, + iV x = V y - iUy. 

(79) 

And, since F f (z) = f(z) = u + iv y we have: 



u = U x = V v and v = V x = — XJ y . 

(80) 

Thus: 

udx — v dy = U x dx + U y dy = dU 

(81) 

and 

u dy + v dx = V x dx + V y dy — dV. 

(82) 


Thus both of the line integrals of equation (76) have exact expres¬ 
sions for integrands in this case. Hence, by section 235, we may 
express the integrals in terms of the end points and 


f m dz = f dU + i f dV = [U(x,y) + iV(x,y)) 

z* C x\y’ 

= F(z ") - F(z'). (83) 


This shows that the rule for expressing the integral of a continuous func¬ 
tion known to be the derivative of another function has the same form 
for complex variables as that for reals. 

Since the form of the derivatives of elementary functions are the same 
for complex values as for real values, at least in suitably restricted 
regions, it follows that the methods of integrating functions in terms of 
elementary functions given in sections 137, 138, and 139 continue to 
apply when the variables are complex, provided the path of integration 
lies in a region in which the elementary function which expresses the 
integral is continuous and single-valued. 
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Incidentally, the equation (83) shows that if F{z) is single -valued in 
a region R, and F' (z) = /(z) in R, then the integral of f(z) from z' to z" 
is the same for any two paths in R joining z' and z". 

265. An Inequality for Integrals. We may obtain an upper bound for 
the numerical value of an integral of a continuous function of a complex 
variable along a path, in terms of a bound for the numerical value of the 
function and the length of the path. We have: 

f f(z) dz = lim 2 /fo) As*. (84) 

VC & = 1 

Let L be the length of the path C. Then, by section 174, each portion 
of arc length is at least as great as the corresponding chord, so that: 

L = Z As* ^ |Az*|. (85) 

From our continuity assumptions, |/(z) | has a bound on C, say : 

1/001 ^ M, on C. (86) 

Consequently, 

I tek\ ^ LI/M|A**i ^ S ML. (87) 


It follows from this and equation (84) that: 



^ ML, 


( 88 ) 


which is the inequality we were seeking. 

This important inequality enables us to extend the results of section 
246 to functions of a complex variable. For, let/*(z) be a sequence of 
functions approaching /(z) uniformly in z along a path C. Then we 
have: 

f f(z) dz - f f t (z) dz = f [f(z) - f t (z)] dz 
I vc vc | I vc 

^ f 1/00 -/*OOI*. (89) 

Jo 


since it follows from equation (84) and section 98 that the absolute value 
of an integral cannot exceed the integral of the absolute value. The 
right member of the relation (89) will not exceed eL, 

if | f(z) -f t (z )| < e, on C. (90) 

But, in view of the uniform convergence, this will hold for all t beyond 
some t f in the sequence, for any positive number e. Hence, since L is 
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fixed, it follows that: 

lim f f t (z) dz - f f(z) dz. 
t Jc “C 


(91) 


In particular, a power series may be integrated termwise along any 
path inside its circle of convergence, since such a path will lie inside some 
circle of uniform convergence. This result also follows from the theorem 
on differentiation of power series, combined with equation (83). For 
cases where the process is valid when one end point is on the circle of 
convergence, see problem 16 of Exercises XIII, and compare problems 
17,18, and 19. 

266. The Cauchy-Goursat Integral Theorem for a Triangle. We 

have seen that power series represent functions which in certain regions, 
namely, any circle of uniform convergence, can be differentiated. We 
shall later prove, conversely, that a function which has a derivative at all 
points of a two-dimensional region, may be represented by a power series 
in any circle lying entirely in the region. As a first step toward this, 
we shall now show that, along any triangle all of whose interior and 
boundary points belong to the region in which the function has a deriva¬ 
tive, the integral of the function is zero. 

Consider then any function f(z) 
which has a derivative at all the in¬ 
terior and boundary points of a tri¬ 
angle and is therefore continuous at all 
these points. Let us divide the tri¬ 
angle into four triangles of the same 
shape and dimensions, half as large, 
by lines through the midpoints of the 
sides. Then, if T denote the perim¬ 
eter of the original triangle, traversed 
in the positive direction as determined 
by the convention of section 233, and T v j = 1, 2, 3, 4 denote the 
perimeters of the four smaller triangles, each traversed in the positive 
direction, we find that: 




f m dz= E f f(z) dz , 

T J *1 ** Tj 


(92) 


ea c h Tj has two sides a part of T and a third side which is a side of 
taken negatively, for j = 1, 2, 3. 
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If we denote by C\ that one, or the one with smallest subscript if there 
is more than one, T i for which 


f f(z) dz ^ f f(z) dz > 
re, 1 Jti 

(94) 

we have: / f(z) dz g 4 I f(z)dz • 

1 J T Me, 

(95) 

We now treat the triangle C\ in the same way we treated the original 
triangle and so obtain a triangle C 2 , such that: 

f f(z)dz £ 4 f f(z)dz • 

\JCi 1 

(96) 

Continuing in this way, we find a sequence of triangles, C n , 
length of Cn+i is 1/2 the length of C n , and 

such that the 

f f(z)dz S4 f f(z)dz • 

1 J C n 1 JCn+i 

Hence the length of C n is l/2 n times the length of T, and 

(97) 

f f(z)dz g 4 n f f(z)dz • 

1 JT 1 "Cn 

(98) 


As n —> oo, the triangles C n close down on a point z 0 . For, if we take 
a point in each triangle, we obtain a sequence of points z n which approach 
a limit by the Cauchy convergence criterion, say z 0 . Since each triangle 
includes all those which follow, any triangle C n includes all the z n with 
sufficiently large subscripts and therefore their limit point z 0 . Again, 
since the maximum dimension of the triangle C« approaches zero, there 
is only one limit point z 0 . 

Since the point z 0 belongs to the interior or boundary of the first 
triangle, T, /(z) has a derivative at z 0 , and 

z—z, Z ~ Z 0 

Hence, for any positive e, there is a 5 such that, if |z — zol < £, 

fM ~ - f '( Zo ) = ee, where |0| g 1. (100) 

z — Zo 

When n is large enough, all the points of the triangle with perimeter 
C n will lie within 8 of Zq. Thus we may use the equation (100) in calcu¬ 
lating the integral of /(z) over C n> and find: 




[/(*<>) + (Z ~ Zo)/(z 0 ) 


+ (z — Zo)0e] dz. 


( 101 ) 
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The first two terms give zero, since they are the derivative of 

F(z) = f(z 0 )z + { - ~ 2 Zo)2 -J\zo), (102) 


which is single-valued for all values of z and the path of integration is 
closed, and so has the same end points, z f = z n in equation (83). For 
the third term, we have: 


J* (z — z 0 )6(z)e dz g € (length C n ) 2 . 


Consequently, 


| | s, (length 

From this and the relation (98) we find: 

f f(z) dz g e (length T) 2 . 

Since the length of T is fixed and e is arbitrary, this proves that: 

J f(z) dz = 0, and hence / f(z) dz = 0, 

i T T 


as we set out to prove. 

267, The Cauchy-Goursat Integral Theorem. A two-dimensional 
region is said to be simply connected if every simple closed polygon 
consisting entirely of points of the region, has all its interior points 
interior to the region. We shall now prove that: 

If a function f (z) has a derivative at each interior point of a simply con¬ 
nected region R , then the integral of f(z) is zero about any closed path 
consisting entirely of interior points of R. 

We first observe that every simple polygon may be decomposed into 
triangles, by line segments contained in the closed region made up of 
the polygon and its interior points. The integral of f(z) around the 
polygon will be the sum of the integrals taken around the component 
triangles. It will therefore be zero, if the points of the polygon are 
interior points of R. This result holds for a polygon which intersects 
itself, since the integral may be decomposed into a finite number of inte¬ 
grals over simple polygons. 

^Consider next any closed path of integration, C, which is a continuous 
, | plrve with an arc length and has all its points interior to R. Then each 
jloint of C is the center of a circle lying in R and since the points of C 
form a closed set, we may select a finite number of such circles which 
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include all the points of C. These circles K together form a closed 
region in R, including C. As f(z) is continuous at all points of this 
closed region, it is uniformly continuous and we may select a 8 for any 
given positive quantity, e, such that for any two points in this region, 
whose distance is less than 8, the function f(z) differs by at most e in 
numerical value. 

Next inscribe a polygon P in the curve C, such that each chord is less 
than 8 and also such that, 


x 


/(z) dz - Z/(z;t) A z k 


< «, 


(107) 


where Az* correspond to the sides of the polygon. We may do this 
using, among other points of subdivision, the points where the circum¬ 
ferences of the circles K intersect C. This will insure that the points of 
the polygon P are all in the closed region consisting of the circles K and 
therefore interior to R. 

For the polygon P, we may form a sum approximating the integral of 
f(z) over the polygon to within e, using points of subdivision z / which 
include the vertices of the polygon. Then: 


f f(z) dz - E/0/) As/ 

J P 


< 6 . 


(108) 


Then, from the choice of 5, if zjk is any point of the side of the polygon 
A Zky we have: 

I /fob) -/(*;*)! <e. (109) 


Also, since Az* equals the sum of certain As/, we have: 


ISffafe) Az* - £/(*/) Az/I g IL* As/1 g €L|A**| ^ eL, 


(HO) 


where L is the length of the curve C. 

From the inequalities (107), (108), and (110), we may conclude that: 


f f(z) dz- f f(z) dz 

Jp d c 


^ c(L + 2). 


(Ill) 


Since L is fixed and e is arbitrary, 


f f(z) dz = f f(z) dz * 0. 

J c J p 


( 112 ) 


268. Multiply Connected Regions. A region which is not simply 
connected is said to be multiply connected. An example is the region 
consisting of the points inside a large circle and outside a number of 
small circles having no points in common and all lying inside the large 
circle. 
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For a function which has a derivative at all the interior points of a 
multiply connected region, M, the integral around a closed path in the 
region is not necessarily zero. However, if all the interior points of the 
region bounded by the path belong to M , the path is in some simply con¬ 
nected region to which the theorem of the preceding section applies and 
the integral is zero. 

More generally, if we have a number of closed paths C' 3) which together 
form C* the boundary of a multiply connected region M ', where C f 
and M f are interior to M , then the sum of the integrals of f(z) about the 

curves C f , taken in consistent directions, 
is zero. Here the consistent directions 
for smooth curves are determined by a 
convention similar to that of section 233, 
that the tangent in the positive direction 
and the inner normal bear the same re¬ 
lation as that of the positive x-axis to the 
positive ?/-axis. For paths C f without 
tangents at certain points, we may use 
approximating curves lying in M' which have tangents to determine 
the directions. 

In either case, the multiply connected region may be separated into a 
finite number of simply connected pieces by curves, or cross-cuts, lying 
in M\ The integral of f(z) about the boundary of each simply con¬ 
nected piece, taken in the positive direction, is zero. In the sum of 
these integrals, the integration along each cross-cut is taken twice, in 
opposite directions and thus cancels, while the remaining boundary of 
the simply connected pieces makes up the curves C', consistently 
oriented. This proves the more general result. 

269. The Cauchy Integral Formula. Suppose f(z) has a derivative 
at all points of a simply connected region R . Then, if a is any point of 
R } the function f{z)/(z — a) has a deriva¬ 
tive at all points of R except a. Thus we 
may apply the theorem of the last section 
to any multiply connected region bounded 
by a curve C in R including a as an in¬ 
terior point and a small circle y with center 
at a and entirely interior to C. The direc¬ 
tion for C may be taken as positively re¬ 
lated to the inner direction. Then, since 
fjjhe radius of y must be extended to give 
the interior of the region, we must take the integral over y in the 
direction negatively related to the inner direction. Or, we may form 
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a sum which is zero by taking the integral along y in the direction posi¬ 
tively related to the inner direction and prefixing a minus sign. Thus 
we find: 


r /(*0 dz r f(z) da _ Q 
J c z — CL J., z — a 


(113) 


But, as/(z) is continuous at a, 


jf(z) =/( a ) + he, where |\| < 1, (114) 


on the circle y, if the radius p is taken sufficiently small. It follows that: 



m dz 

z — a 


X 


/(q) dz 
z — a 


+ 


X 


t\(z) dz 
z — a 


For the first integral in the right member, we have on putting 

z — a — pe l6 ) dz — pie t9 dd, 

J f* f(a) dz r 2 * 

■* / f(a)id$ = 2 

y Z — CL a/Q 


(115) 


(116) 

(117) 


Here 6 plays the role of t in section 263. For the last integral in 
equation (115): 


J r* €\(z) dz 
7 z — a 

Our equations may be combined to give: 

' f(z) dz 


^ — 2t p S 2 tt€. 
P 


Jr 2 — a 


S 27 re. 


(118) 


(119) 


Hence, since < is arbitrary, the left member is zero and 



m dz 
z — a 


( 120 ) 


This is Cauchy’s integral formula. It expresses the value of /(z) at 
any point a interior to a region R in which /(z) has a derivative in terms 
of the integral taken about any closed path C in R, bounding a simply 
connected region including the point a. The discussion of section 268 
shows that the formula still holds if we use as the path of integration C\ 
the complete boundary of a multiply connected region including a in its 
interior and lying in R. 
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270. Taylor’s Series. Let the function f(z) have a derivative at all 
points of a region R. Let a be a point in R } and draw a circle with 
center a, lying entirely inside R. Let t be a point on this circle and z 

any point inside this circle. Using the 
circle as the curve C of Cauchy’s integral 
formula for the point z, with t as the vari¬ 
able of integration, we have: 



t — z (t — a) — (z — a) 


m ~hL 

But we may write: 

-i-r 

t - aL 

(z - a) 


f(t) dt 
c t — z 


( 121 ) 


1 + 


z — a (z — a) 2 


t — a 


+ 


+ 


it - a) 

If r is the radius of the circle C, 

i* 


n—1“ 
n—1 


+ 


it - a) 2 

jz ~ a) n 

(t — a) n (< — z) 


( 122 ) 


z — a 


\t — ai 


< 1, 


(123) 


so that for z fixed and all values of t on the circle C, the infinite series 
1 z — a 


+ 


t — a (t ~ a) 2 (t — a) 


(,z — a) 2 
+ ^ 7 , -C3 + 


i (! ~ ■ 

(t — a) n 


(124) 


converges to l/(t — z). Moreover the convergence is uniform, since 
the remainder after n terms has a numerical value 


(* - a) n 


'|2 - a\~ 

n x 

(t — a) n (t — z) 

r 

1 h ~ s\ ’ 


(125) 


where t\ is the point of the circle C nearest to z . 

Since f(z) is continuous on (7, it is bounded on C, so that termwise 
multiplication of the series (124) byf(t)/2Ti will not disturb the uniform 
convergence. Thus we may integrate the new series termwise and find 
from equation (121) that 


f(z) = Ao + Ai(z - a) + A 2 (z - a) 2 H- 

+ A„(z — a) n + • • • , 


x. where 


J_ f dt 
2iri J c (t - a)” +1 ' 


(126) 

( 127 ) 
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Since the series (126) is a power series convergent for all z with 
\z ~ ®| < its radius of convergence is not less than r and it may be 
differentiated termwise any number of times. Thus 
00 

fU(z) = £ n (n - l)(n - 2) • • • (n - k + 1 )A n (z - a) n ~ k . (128) 

In particular, we may put z = a, which gives: 

f k) (a) = fc ! A*, or A, = • (129) 

Thus, under the conditions stated, the function/(z) has derivatives of 
all orders at the point a and the coefficients of its power series expansion 
about the point a have the same form as those of the Taylor’s develop¬ 
ment of section 89. 

271. The Morera Theorem. As a converse to the Cauchy-Goursat 
theorem of section 267, we have the theorem of Morera: 

If a single-valued continuous function f(z) has its integral zero about 
every closed path consisting entirely of interior points of a region R, then 
the function has a derivative at each interior point of R. 

To prove this, select any fixed point of the region B, z 0 , and consider 
the integral of /(z) from z 0 to z, a second point of B, along any path lying 
in R. If Ci and C 2 are any two such paths, Ci and C 2 taken with 
reversed sense, form a closed path. Hence, by our hypothesis, the inte¬ 
gral over Ci minus the integral over C 2 is zero. Thus the integral from 
z 0 to z is the same for all paths in B, and so may be used to define a 
single-valued function in B, 

F(z) = f f(t) dt , over any path in B. (130) 

Let us form the difference quotient of B(z), 

(131) 

Az h hJ z 

Since f(z) is continuous at z, for any positive e, there is a 5, such that: 

1/(0 ~ /(01 < if I t-z\< S. (132) 

Thus, if we take |ft| < S and use a straight line path joining z and z + h, 
which will be in R for h sufficiently small, we may put 

f(t) = /(*) + 6t > with |0| < 1, 


(133) 
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for the integrand in equation (131). That is: 

/**+A 


/ +» pt-Th pt-th 

fit) dt = J [f(e) + &) dt = A/(z) + J «e d*. (134) 
For the last integral 

\J a(t) dt e|A|. (135) 

Hence we may conclude from equations (131), and the last two, that: 


A F 
A2 


-m 


for \h\ = |Az| sufficiently small. It follows from this that 

AF 

lim— = m. 

Az 


(136) 


(137) 


Thus F(z) has a derivative at z, any point of R. Hence, by the reason¬ 
ing of the last section, all the derivatives of Fiz) exist and in particular 
the second derivative, 

F"iz)~f'iz), since F'(z)=/(z). (138) 

That is, fiz) has a derivative at any interior point of R, as we set out 
to prove. 

272. Analytic Functions. A single-valued function fiz) is said to be 
analytic at a point z, if it has a derivative at z and at all values in some 
two-dimensional region including z as an interior point. We say that a 
function is analytic in a region R, if it is analytic at all points of R. 
Throughout this section, R will always denote an open two-dimensional 
region. 

By the preceding section, fie) is analytic in R if it is single-valued and 
continuous and may be integrated in R in the sense that its integral 
around every closed path is zero, or between any two points is inde¬ 
pendent of the path. 

Similarly, any function which is analytic in a simply connected region 
R, satisfies this condition by the Cauchy-Goursat theorem. 

By se$$pn 262, a function represented by a power series is analytic 
at all'-ptilhis inside its circle of convergence. Also, by section 270, a 
fqnfipn analytic at a point may be represented by a power series expan- 
< n^wout this point. 

:J! tw last fact shows that an analytic function has derivatives of all 
orders and hence these are all continuous. Thus, by section 258, if 
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f(z) * u + iv } u and v will each have first partial derivatives which are 
continuous and satisfy the Cauchy-Riemann differential equations. 

We thus have necessary and sufficient conditions for analyticity, or 
alternative definitions, in terms of derivatives, integrals, power series, 
or the Cauchy-Riemann differential equations. Each of these is a con¬ 
venient method of proving analyticity under certain conditions. 

A function, proved to be analytic by any of these tests, has all the 
properties just mentioned. It also possesses derivatives of all orders, 
each of which, like itself, is continuous and in fact analytic. Also, by 
the reasoning of section 271, it follows that the integral of an analytic 
function is an analytic function of its upper limit. 

273. Uniformly Convergent Sequences of Analytic Functions. In 
section 265 we proved that if f t (z) is a sequence of continuous functions 
approaching /(z) uniformly for z on a path C, then 


lim f f t (z) dz = f f(z) dz. (139) 

t “C 


We may deduce from this that if the sequence of functions f t {z) 
approaches/(z) uniformly in an open two-dimensional region R and all 
the ft (z) are analytic in R } then/ (z) is analytic in R . 

For, from the first condition the f t (z) are continuous functions and 
each has an integral around every closed path C in R equal to zero. 
Hence, by equation (139), /(z) has its integral about every closed path C 
in R equal to zero, so that/(z) is analytic in R. 

In particular, the sum function of a series uniformly convergent for z 
in some open two-dimensional region R is analytic in R if the terms of the 
series are each analytic in R. 

If f t {z) approaches/(z) uniformly in 72, then the function 


1 ftW 
2iri ( u — z) 2 


approaches 


1 

2wi (u — z) 2 * 


(140) 


uniformly for u on any circle C with center z lying in R. Hence the inte¬ 
gral of the first expression taken over this circle C approaches that of the 
second over C. If each function f t (z) is analytic in R f f(z ) is analytic in 
R by the theorem just proved and we may apply equations (127) and 
(129) to conclude that: 

ft (z) approaches f(z ). (141) 


In particular, the sum function of a series of analytic functions may be 
differentiated termwise at any point z if the separate terms are each 
analytic and the series converges uniformly, in some two-dimensional 
region including z as an interior point. Similar reasoning applies to the 
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higher derivatives, so that we may differentiate termwise any number of 
times. 

We may use this to prove the following theorem: Let 

w k {z) = L c kn z n , (142) 

n=l 

and 

00 

X a k w k (z) = w(z), (143) 

with all these infinite series uniformly convergent in some two-dimensional 
region R including the origin as an interior 'point. Then , in any circle 
about the origin lying in R, 

w(z) = £ ( £ a k c kr ^)z n , (144) 

and the series on the right is the Taylor's series for iv(z). 

By our hypothesis, each function w k (z) is analytic in R. Hence from 
the uniform convergence of the series (143), the function w(z) is analytic 
in R. Hence w (z) is analytic at z = 0 and has a Taylor’s series expansion 
about this point, or in powers of z. The coefficients are given by equa¬ 
tion (129), so that: 

w(z) = £ —,w (n) (0 )z n . (145) 

n— i n ! 

But, since the series (142) converges uniformly, it may be differen¬ 
tiated termwise to give: 

(0) = n ! Ckn- (146) 

Similarly, by termwise differentiation of the series (143), 

W (n) (0) = £ a k wV( 0). (147) 

k — 1 

The last two equations prove that: 

—,w^(0)=ta k c kn , (148) 

so that the expansion (144) is the same as the Taylor’s expansion (145). 
Since the function w(z) is analytic in R , the series equals w(z) inside any 
9 f$le about the origin lying in R . 

JfciMu Operations on Power Series. Any operation on one or more 
fl*fiBiiytic functions which leads to an analytic function corresponds to a 
method of deriving a new power series from one or more given power 
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series. We shall illustrate our remarks for power series about the 
origin, since for other points we have merely to replace z by z — a. 

Let 

/(z) = HcinZ 71 , for I?) < Ri (149) 

and 

Q(z) = 2Xz n , for |z| < R 2 . (150) 

Then 

/(z) + g(z) = 2(a n + 6 n )z n , for \z\ < min (R U R 2 ) 9 (151) 

since for any z satisfying the inequality each of the series converges 

absolutely. 

Similarly, by section 203, the series may be multiplied to give 

f(z)g(z) = 2 ( £ a m b n — m \ Z , for \z\ < min (Ri>R 2 ). (152) 

n— 0 \m ~0 / 

By a repetition of the last process, we may find the series for the 
successive powers of a given series. For example, in the case of a series 
with first term zero, 

h(z) = C\Z + c 2 z 2 + c 3 z 3 H-, (153) 


we find for the powers 

[h(z)] 2 = cfz 2 + 2cic 2 z 3 4-, 

[ft(z)] 3 = c\z s + ■ ■ ■, 


(154) 


Each of these converges inside any circle of uniform convergence for the 
first series. 

Hence, as in section 83, we may find the power series for a function of a 
function of this type. Thus, from 

m = i/a”, (155) 

we may find the formal expansion: 

4 " diCiZ 4 “ (cl\C 2 + d 2 c\)z 2 + {ci\C 3 4 " 2a 2 c\c 2 + &3 c i)z 3 4 “ * * * • ( 156 ) 

That this is the TayloFs series for the function f[h(z)] and hence con¬ 
verges in any circle inside the region in which this function is analytic 
follows from the result at the end of the last section, provided that the 
series 

Za n [h(z)] n (157) 

converges uniformly for z in some region including the origin as an 
interior point. But, since h(z) is continuous at z = 0 and is zero for 
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z « 0, there is some region R in the z plane, including the origin in its 
interior in which: 

IM*)I < r, (158) 

a radius of uniform convergence for the series (155). Then for z in this 
region, R, 

\a n [h(z)] n \ £ |a„|r*. (159) 


But the series |a«|r n converges, since a n r n converges absolutely. Hence, 
by the Weieretrass ilf-test, the uniform convergence of the series (157) 
in R is established. 

276. Functions with Parameters. Let f(z,w) be a continuous func¬ 
tion of the two complex variables z and w, that is of four real variables, 
the real and imaginary components of z and w. Then, if for each value 
of w considered, the function f(z,w) is analytic in some two-dimensional 
simply connected region R of the z plane, the function 

F(z) = f f(z,w) dw (160) 

is analytic in R. For, if C is any closed path in R. we have 



(161) 


The double integral reduces to a number of double real integrals of con¬ 
tinuous functions, for each of which the order may be inverted. Also 
the second integral is zero, since the integral of f(z,w) with respect to z 
is zero over C by the Cauchy-Goursat theorem. But the first integral 
of (161) is the integral of F(z) about any closed curve C in R. Hence 
the function F{z) is analytic in R by the Morera theorem. 

If we replace the path Cj by a path extending to infinity, or ending at 
a point at which f(z,w) is not continuous, the integral (160) will still 
define a function analytic in z, provided that the improper integrals 
converge uniformly for z in R. For in this case it will be the uniform 
limit of proper integrals, each of which is analytic in z by the first result. 
For the same reason, the result persists if, on C, f ( z,w ) is not necessarily 
itself continuous in all four real variables, but its integral on C is the 
uniform limit of integrals of functions each of which is continuous in 
the two complex variables z and w. 

1£f(z,w) has a derivative df/dz which is a continuous function of the 
two complex variables z and w, 


F(z) => f f(z,w) dw, 
**c 


and if 


( 162 ) 
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then 



(163) 


To prove this, we note that since / (z,w) has a derivative with respect 
to z, it is analytic in z. Hence, by the previous result, the function 
F(z) is analytic in z. Also, by section 270, we have: 




F(t) dt 


(t - *) 2 


where C' is a small circle about z, so that 


(164) 


F'{z) 


-L fa rim±. 

2iriJc’ Jc (< — z ) 2 


(165) 


Since the function f(z,w) is continuous in the two complex variables 
and t — z ^ 0 for t on C', we may invert the order of integration. For 
this is equivalent to the inversion of order in a number of real double 
integrals, each with a continuous integrand. Furthermore, we have by 
section 270, 


1 f dt _ df 

2iriJ C ' (t — z) 2 dz 


(166) 


Thus we find: 


F' 




f&w) dt 
(t ~ z) 2 


(167) 


which is the relation to be established. 

276. Laurent’s Series. If /(z) is a single-valued analytic function of 
the complex variable z for all points in a region R including a in its 
interior, the Taylor’s series in powers of (z — o) will represent the func¬ 
tion in any circle C of radius r, with a as its center, lying entirely inside 
the region R. 

Now suppose that the function is not necessarily analytic at the point 
a itself, but is analytic at all other points of R. Then it is possible to 
represent the function, at all points distinct from a and in any circle of 
type C, by a series involving both positive and negative powers of 
(z — o), the Laurent series for the function about o. 

To prove this, let us first consider a ring shaped region bounded by two 
circles, C x of radius r x and Ca with radius r^, it < r 2 , each with center 
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at a and lying entirely inside R. Then, we may apply the Cauchy 
integral formula to any point z in this region to obtain: 



(168) 


Here the circles C\ and C 2 are each traversed in the positive direction 
and the minus sign is due to the fact that C\ the smaller circle must be 
traversed negatively when considered a part of C* y the boundary of the 

ring. 

Since fit) is analytic in R y which 
includes C\ and C 2 , and z is not on 
either curve, the first integrand is con¬ 
tinuous in z and t and analytic in z, for 
t on and z inside the outer circle C 2 . 
Therefore the first integral represents 
an analytic function in this region and 
so may be expanded in a Taylor’s series 
in positive powers of (2 — a) which 
represents the integral inside C 2 , and 
hence in the ring. 

The second integrand is continuous in z and t } and analytic in z for t 
on and z outside the inner circle C\. Since it is analytic for \z — a\ > r \, 
if we put: 



Z = 



JL_ Z 

t ~ z Z{t — a) — 1 


(169) 


and is analytic for Z < 1 /rj. Thus the second integral of (168) is an 
analytic function of Z for these values and so may be expanded in a series 
of powers of Z . Since the last fraction of (169) is zero for Z = 0, the 
same is true of the integral and the expansion will contain no constant 
term. This gives a series of positive powers of Z, or of negative powers 
of (z — a) which represents the second integral for Z < 1/n, or 
\z — a| > r%. That is, outside the circle C\ and hence in the ring. 

On combining the two expansions, we have a series: 

/(*) - i An(z - a) n . (170) 

ft =—ac 

If C 3 is aHy<&cle with center at a and radius r, with 
< i'-' ri < r < r 2 , 


( 171 ) 
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the series (170) will converge uniformly for z on the circle C 3 . The 
uniform convergence will not be affected by multiplying by (z — a)~ k ~ l 
whose numerical value is r~ k ~ l on C 3 . And, after multiplication by this 
factor, we may integrate the series termwise. All the terms give zero 
except the term Ak(z — a ) -1 and we find: 


J * f(z) dz . A , 

a <rHjra - ^ < I72 > 

This determines the coefficients. It follows from the Cauchy integral 
theorem that the integral will be unchanged if we replace C 3 by any closed 
curve in R bounding a region including a in its interior. Hence the 
coefficients are independent of the choice of C 1 and C 2 . By taking the 
radius sufficiently small, we may make the ring include any point 
inside C 2 distinct from a. Hence we have: 

If the function f(z) is single-valued and analytic in a region R, with the 
possible exception of the point a and C is any circle with center a lying in 
R , then the Laurent expansion 

m = £ A n (z- a) n (173) 

n =z— 00 

is valid for all points inside the circle C, distinct from a. 

The coefficients are given by 


1 C /(g) dz 
2 wi Jq> (z — a ) n+1 


(174) 


where C f is any closed curve in R bounding a region including the point a in 
its interior. 


277. Singular Points. If a function f{z) is not analytic at a, but is 
single-valued and analytic at all other points of some two-dimensional 
region including a as an interior point, then a is called an isolated singular 
point. By the preceding section, at any isolated singular point, there is 
a Laurent expansion of the type (173). If the expansion contains no 
negative powers, the expansion represents a function analytic at a, so 
that if we redefine our function at a as A 0 , the value of the series, the 
function will become analytic at a. In this case the point a is called a 
removable singularity. In this case the function only fails to be analytic 
because it is undefined, or differently defined from Aq , at one point. 
Since defining/(a) as A 0 makes the function continuous at a, it follows 
that if f{z) is continuous at a and has at most a removable singularity 
at a, then/(z) is analytic at a. 
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If the expansion (173) contains only a finite number of negative 
powers, so that it can be written: 

' /to = £ A n (z - a) n , (175) 

n«-m 

then the function is said to have a pole at the point, of order to, where to 
is the highest power of (z — a) -1 in the expansion. We note that in 
this case /(z) (z — a) m is a power series and so is an analytic function of z 
at a. Also to is the smallest integer for which this is the case. Since 

lim (z - a) m f(z) = A_ m ^ 0, (176) 


it follows that, at a pole, 

lim |/(z) | = oo. (177) 

Since (z — o) m /(z) is analytic at a and different from zero there, its 
reciprocal 


F(z) = 


1 

/(*)(«-<*)" 


(178) 


is analytic at a and different from zero there. 

When a function is analytic and the first non-zero coefficient of its 
Taylor’s expansion is A m , so that 

g(z) = £ A n {z - o) n , A m 9* 0, to > 0, (179) 

n»m 


it is said to have a zero of the mth order. A comparison of this with the 
preceding equation shows that, if f(z) has a pole of the mth order, l//(z) 
has a zero of the mth order and conversely if a function has a zero of the 
mth order its reciprocal has a pole of the mth order. 

An isolated singularity which is not removable and not a pole is an 
essential singularity . 

If the values of f(z) admit an upper bound in R, so that 

l/tol ^ M, (180) 


the formula for the coefficients of the negative powers, with the integrals 
taken over a circle C about a of radius r, shows that: 


I A. 


j_ r /(g) dz 

2 nJ c (z - a)~ m+1 


<. Mr m . 


(181) 


Since this cannot change with r and approaches zero when r approaches 
senn it follows that all the negative coefficients are zero and the function 
^''lither analytic or has a removable singularity at a. (Riemann’s 
theorem.) 
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If the values of f(z) do not admit an upper bound, for some region 
including a, there must be a sequence of values, z n , with 

lim z n = a, lim |/(z n )| = «. (182) 

n n 

At a pole, 

lim |/(z)| = oo, (183) 

z—*~a 

so that this is true for all sequences of values. Conversely, if this is 
satisfied, the function has a pole at a. For, in this case 

lira 77 - = 0, (184) 

z-+a J [Z ) 

so that the values of 1 /f(z) admit a bound M in some region including a. 
Thus, this function has at most a removable singularity at a and becomes 
analytic if we take 0 as its value at a. If this zero is of the rath order, 
then/(z) itself has a pole of the rath order. 

This shows that, if a function has an essential singularity at a , the 
function can neither become infinite for all sequences z n —> a, nor 
approach the same finite value for all sequences z n —» a. It follows that, 
for suitable sequences of values z n —> a , the function can be made to 
become infinite, or approach any finite value whatever, as we shall now 
prove. For there must be a sequence satisfying the relation (182), or 
the function would admit an upper bound. Again, if /(z) has an 
essential singularity at a, then 1 /[/(z) — b] must also have an essential 
singularity at a, since if it approached the same finite value or became 
infinite for all sequences z n —+a, the behavior of f(z) would be corre¬ 
spondingly restricted. Thus this function admits a sequence z n such 
that: 


lim z n — a 

n 

and lim . , = «. 

/(*») ~ b 

(185) 

But this implies that: 

lim f(z„) = b, 

(186) 


and b is any complex number, so that we have proved our contention. 
This result is known as Weierstrass’s theorem. 

278. Residues. The residue of a function/(z) at a is the coefficient 
of (z — a)~~ l in its Laurent expansion, or 

R (a) = ^ J m dz, (187) 

where C' is any curve bounding a region including a, such that C' and 
the region it bounds are interior to R, a region in which/(z) is analytic. 
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It follows that, for any curve of this type, 



dz = 2viR(a). 


(188) 


By the Cauchy-Goursat integral theorem, the integral is zero if f(z) is 
analytic at a. This also follows from the fact that in this case the 
Laurent expansion reduces to the Taylor’s expansion, with no negative 
powers, so that the residue at a is zero. 

Next consider a function analytic throughout a region R , with the 
exception of a finite number of isolated singularities a*. Let C be any 
curve or set of curves forming the complete boundary of a portion of R> 
along which the function is analytic. Then, if the portion of R bounded 
includes n of the points a*, we may surround each of them by a small 
closed curve C* so that the curves C* all taken negatively, together with 
the curve C taken positively bound a region in which f(z) is analytic. 
Hence, by the integral theorem, the integral about all of these will be 
zero and the integral about C will equal the sum of the integrals about 
Ck, taken positively. But, since each of these integrals is 2^72 (a*) > it 
follows that: 

f f(z) dz = 27 ri 2 (189) 

c 


This is known as Cauchy’s residue theorem. 

It may sometimes be applied to the evaluation of real integrals as we 
shall show in sections 280 and 281. 

We note that, at a simple pole, 

/(«) = -4_i(z — a) -1 + A 0 + Ai(z — a) + A 2 {z — a) 2 H- (190) 

and hence 

= lim (z - a)f(z). (191) 

z-~+a 


At a pole of higher order than the first, the product (z — a)/(z) 
becomes infinite. However, the residue is finite. Nevertheless, it is 
worth while to calculate the limit on the right of equation (191). For, 
if this is not zero, it shows that the singularity is a pole of the first order 
and the limit gives the residue. If the product becomes infinite, we 
have a pole of higher order. In other cases the product approaches 
different limits for different sequences and we have an essential singu¬ 
larity. In either case further investigation is necessary to determine the 
residue. For poles of higher order, say the with, we may use problem 30 
ofiJExercises XIII. Or the coefficient may be obtained by dividing 
two Baylor’s series, or by dividing a Taylor’s series by (z — a) m . The 
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division of two Taylor’s series is reducible to (z — a) - "™ times the 
division of a series by one with non-zero constant term, or multiplication 
by its reciprocal. This may be accomplished by the procedure of 
section 83, which is justified for complex values by the theorems of 
section 274. 

In calculating the residue at a simple pole, any analytic factor distinct 
from zero at a may be replaced by its limiting value. For a multiple 
pole, or an essential singularity, this procedure is not applicable since 
equation (191) does not hold. Thus the function (z — 1 )~" 2 has a 
residue zero at a — 1 , and (z — 2)"~ 1 approaches a finite limit at 1 , but 

(* - 2) _i (2 -1)- 2 = (2 - ir 2 (-i) —- * - - 

= - (2 - ir 2 u + (2 -1) + (z - 1) 2 + • • •] 

= - (2 -1 r 2 - (2 -1)- 1 -1 —, (192) 

so that the product (z — 2 )~~ l (z — 1)“ 2 has a residue — 1 at a = 1 . 

The methods just mentioned enable us to find the residue of any 
rational function, or of the product of a rational function times an ele¬ 
mentary function, or any analytic function whose Taylor’s series at a is 
known. It is frequently convenient to begin by decomposing the 
rational function into partial fractions, as in section 115. 

279. Change of Variable in an Integral. If we make a change of 
variable from z to Z by means of an analytic function z(Z) which maps a 
smooth curve C f in the Z plane into a curve C in the z plane, the integral 


fm dz 

(193) 

is transformed into 


f f[*(Z)]z'(Z) dZ . 

t/C" 

(194) 

To show this, we introduce a real parameter t along the curve, and 
reduce each of the above integrals to real line integrals, by expanding: 

(dx dy\ 

(u + iv) (dx + i dy) = (u + iv) 1 — + i — j dt 

(195) 

(dx dy\(dX , ,dY\ , 

and + + + 

(196) 

The second factor represents dz/dZ by equation ( 6 ). 

But, by the Cauchy-Riemann differential equations: 



dx dy , dx dy 
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By using these we find: 



/ dx dX dx d 
W ~dt + dY ~dt 


S) 


+ ’•(; 


dy dX dy 
,dX dt + dY 



(198) 


Finally, by the rule for forming total derivatives, this is: 

dx , .dy 

— -L i — • 

dt dt 


(199) 


This reduction shows that the expression (196) is the same as the 
expression (195). Hence, when expressed in terms of the parameter t, 
both the integrals (193) and (194) assume the same form. Consequently 
these integrals are equal, as we stated. 

280. Real Integrals. Let us consider any rational function of sin t y 
cos t, which is never infinite for real values of t. Its integral between the 
limits 0 and 2ir may be evaluated by putting 

__ j 2^ , j^ ^ 

z = e u , sin l — ——— , cos t — —-— , dt — — • (200) 

JjLZ JdZ %Zr 


This reduces the integral to that of a rational function about a circle of 
radius unity about the origin, with no poles on the circle, so that it may 
be evaluated in terms of the residues of this function. 



/ F(z ) dz t as M Suppose, further, that along some contours 

M 

Sm> frequently taken as semi-circles, each including the preceding and 
joining M to —AT in the upper half plane, we have: 


lim f F(z) dz - 0. 


( 201 ) 
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Then, if the contour Sm together with the part of the real axis between 
—M and M includes the n singular points of F(z ), a* and F(z) is analytic 
at all points in the upper half plane except the points o&, 

f F(z) dz + f F(z) dz = 2wi £ R(a k ). (202) 

J-M Js M 

On taking the limit as M becomes infinite, since n increases it will 
either approach a finite limit, p, or become infinite. The second integral 
on the left approaches zero, so that: 


z ' 00 p or oo 

/ F(x) dx = 2wi £ Fifth)- 


Let the function Q(z ) be a rational function whose denominator is of 
degree n + s> s S 2, while the numerator is of degree n. Let Q(z ) have 
no poles on the real axis. Then the preceding reasoning applies, with 
F(x) = Q(x). For, we have: 

lim \z 8 Q(z)\ = h f < k. (204) 

z—*-00 

Thus, for M sufficiently large, on <Sm, a semicircle of radius AT, 

|<2(2)1 < /cM~ 2 , (205) 

so that 


f Q(z) dz < 7T MkM~\ 


which approaches zero when M becomes infinite. 

This proves that, if the denominator of a rational function Q(z) is of 
degree at least two higher than the numerator, has no real roots and has 
roots ai, a 2 , • * * , a p in the upper half plane, then: 


f Q(x ) dx = 27 n 2D R(a k ). 


281. Certain Trigonometric Integrals. If the function G(z) is less 
than K in absolute value on a semicircle Sm, of radius M } we have on that 
semicircle: 

z = Me xd = M cos 6 + iM sin dz = iMe td dd , (208) 

and 

\e imz G(z)\ g (209) 

But, by problem 46 of Exercises IV, 

2^6? for 0<»s=. (210) 

6 7T 2 
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and hence if m > 0 , as we shall assume, 


/' 

wo 


-mM sin® 




2 mM Bin 9 


de 


g 2 f 2 e ~ 2mMeir de g — e ~ 2mMeiT 

J o mM 


It follows from these results that: 

f e lmz G(z) dz \ £ f \e tm *G(z)iMe* \d» g 
I'Jsm I 




mM 

kK 

m 


( 211 ) 


( 212 ) 


If lim G(z) = 0 , we may choose a series of values of K —»0 and a 
*—►00 

corresponding set of semicircles Sm- Thus, for these contours 


lim f e tm *G(z) dz = 0. 

M-+*> J S M 


(213) 


It follows from this by reasoning as in the preceding section that if 
G(z) is analytic on the real axis and in the upper half plane except at the 
points ajcy 

lim f e lm *G(z) dz « 2 iri £ R(a k ), (214) 

M—>oo ~M A: = 1 


where the residues on the right are those of e xmz G(z). 

In particular, if Q(z) is a rational function whose denominator is of 
degree at least one higher than that of the numerator, then all our 
conditions will be met if there are no poles on the real axis and we may 
put G(z) = Q(z). We then have: 

/ M p M r M 

e imi Q(z) dz = I e imi Q(z) dz + / e~ imz Q(-z) dz, (215) 
M Jo Jo 

where we have replaced z by — z in the second integral. 

Hence, if Q{z) is an even function, Q(—z) = Q(z), and 


n w 

mA 


/ M 

e tm ‘Q(z ) dz = 2 I Q(z) cos mz dz. 
U Jo 

in, if Q(z) is an odd function, Q(—z) = —Q(z), and 


pM 

lim / i 

J-M 


e' mt Q(z) dz - 2 i 


Q(*) 

0 


sin mz dz. 


(216) 


(217) 
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Thus we have, for Q(z) an even rational function of the type described: 


J 

r 00 

Q(x) cos mxdx = iriJ£R(ak). 

0 

(218) 

And for an odd function, 


j 

r 00 

Q(x) sin mx dx = w^R(ak). 

0 

(219) 


In both these equations, the residues are those of e imz Q{z ), 

In the latter case, the integral on the left will converge if Q(z) has a 
simple pole at the origin, since sin mz has a zero there. In this case, we 
may apply the reasoning to the contour consisting of two semicircles, of 
radii M and M', and the parts of the axes between them. We here let 
M -4 oo as before and M' approach zero. Then, on the small circle we 
may write: 

e imI Q{z) = — +A (z), (220) 

z 


where Ro is the residue of Q(z) at the origin, and A (z) is analytic at the 
origin. Since A{z) remains bounded, while the length of the path 
shrinks to zero, the contribution of the second term approaches zero 
when M f —> 0. But that of the first term is — wiRo y in the left member, 
or when transposed iriR 0 . Thus in the case considered the term Ro/2 
must be added to R(ak) in equation (219). 

An example is Q(x) = 1 /x, with residue 1 at the origin, so that 
Ro /2 = 1/2, and as there are no other poles: 




( 221 ) 


282. Analytic Continuation. Suppose that a function f(z ) is single¬ 
valued and analytic throughout some simply connected two-dimensional 
region R. Then its value at any point interior to R is determined by its 
Taylor's series development at any point z 0 inside R . For, if z is any 
other point of R y we may join z 0 and z by a curve lying in R. Since this 
curve is composed of interior points and with its end points forms a closed 
set, there is a distance d such that a circle of radius d, with center at any 
point of the curve, lies in R . Now take a sequence of points on the curve, 
z 0) 2i> % 2 f * * * t z n = z y such that the distance between any two points is 
less than d. Then the Taylor's development at z 0 is valid at z%. Hence 
it determines all the derivatives of f(z) and so the Taylor's development 
there. Similarly each development at determines the development at 
Zi+i and so finally the value of the function at z . 
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The argument shows that any conditions which determine the values 
of the function and all its derivatives at z 0) for example the values on any 
arc through z 0 , determine the value of the function in R . In particular, 
if the function is zero along any arc and analytic in R, it must be zero 
throughout R. This establishes the “ principle of the permanence of 
form,” which states that, if f(z) = g(z ) along any arc, inside a simply 
connected region R in which both functions are analytic, the equation 
holds for all values in R. For, under the assumption, f(z) — g(z) = 0 
on the arc and therefore throughout R. This explains why the defini¬ 
tions which led to functions e z and sin z anatytic for all values of z, 
preserved all the familiar relations involving these functions originally 
established for real values. 

283. Branch Points. If we start with a Taylor’s development at a 
point and a curve through the point, it may be possible to obtain a series 
of elements or Taylor’s expansions which collectively lead to a function 
single-valued and analytic at all points of the curve, by the process of 
analytic continuation described in the last section. Now consider a 
region R consisting of those points inside some circle with center at A, 
where z = a and not lying on a particular radius AB. Suppose that, 
starting with an element at some point of R, the process of analytic 
continuation leads to a function single-valued in R, but to two different 
elements for each inner point of the radius AB, depending on the side of 
approach, if we attempt to extend the continuation across AB. Then 
the element in R determines one branch of a multiple-valued function 
and a is called a branch point for this branch. 


For example, any determination of \^z, n an integer, log z, or z c 
with c not an integer (positive, negative or zero) and any line through 
the origin determines a single branch of the function, having a branch 
point at the origin. Again log (1 — VT — z), with R a circle about the 
origin, of radius 1/2, with any radius omitted, leads to a branch with a 
branch point at the origin for any determination which makes 
Vl — z = 1 at the origin and to a branch which may be continued to a 
function single-valued and analytic at all points of the circle and in 
particular at the origin, if the determination makes Vl — z = — 1 at 
the origin. This shows that, for a multiple-valued function, a point may 
be a branch point for some branches and not for others. 

In place of a radius AB, we may use another curve joining A to B , on 
the circle, which prevents us from drawing a closed curve surrounding 
A in R to define a branch. We modify the definition of branch point 
^teordingly. Such curves AB are known as branch cuts. 

% a branch of a function /(z), defined in a region R f consisting of all 
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points outside a circle about the origin, with some curve extending from 
a point of this circle to infinity removed, is such that when we put 
z = 1/Z, transforming R' into R in the Z plane, the branch f(l/Z) in R 
has a branch point at the origin, we say that / (z) has a branch point at 
infinity. Thus z c , c non-integral, and log z have branch points at infinity 
for every branch. 

If, in a region either finite or extending to infinity, we locate all possible 
branch points and draw a curve joining each to infinity, we may obtain a 
region in which the function considered has a single-valued branch by 
omitting from the first region all points belonging to the curves drawn. 
For any pair of branch points, we may replace the lines to infinity by a 
single line joining the points, if infinity is not a branch point. For 
example each of the functions 

V (z — a)(z — b) and log (z — a) — log (z — b) 

has single-valued branches in the region obtained from the plane by 
omitting the line segment joining a and b. If infinity is a branch point, 
we must leave at least one curve joining infinity to a finite point. Thus 
for log (z — a) + log {z — b) we may use a line joining a with b , together 
with a line joining a with infinity. For log ( z— a) + log (z — b) + 
log (z — c), we may use a line joining a and b , together with aline joining 
c and infinity. 

In any region in which a multiple-valued function has a single-valued 
branch, w r e may apply all the theorems on single-valued analytic func¬ 
tions, such as the integral and residue theorems, to this branch. 

284. An Expansion in Rational Fractions. Let f{z) be analytic at all 
finite points of the plane, except the points a x , a 2 , a 3 , • • • , where 

0 < \ai\ ^ |a 2 | ^ [usl ^ • (222) 

and let these be simple poles with residues 6 i, b z , 63 , * • • . Then consider 
any contour C n , with no poles on the contour, bounding a region includ¬ 
ing the first p n poles. Then, for any value of z distinct from all the a 
we have: 

X. /w 

= 2ri {/(«) - /(0) + £ b n ["—--1} . (223) 

l fc*l L&n Z Cf n JJ 

by the residue theorem. 

If a series of contours can be found, such that as n — * <®, the limit of 
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the integral on the left is zero and p„ —> eo, it follows that: 

m - m + lim £ 6n r —— + -1 • (224) 

1 ~ a, n J 


In particular, if the contours are similar figures, their lengths, maxi¬ 
mum and minimum distances from the origin will all be fixed constants 
times some dimension M n . Thus, if 


\f(w)\ ^ K n \w\, on C ttl (225) 

we shall have: 



l~ _ C f (w)z dw 

V)\ JCn W ( W ~ Z ) 


g K n \z\q » 


(226) 


where q is a constant depending on the shape of the contours, 
providing that the minimum distance from the origin exceeds 
2|z|, or |u> — z\ > \w\/2. Thus the integral will approach zero if we can 
select constants K n approaching zero as n —» « . In particular, in any 
region inside some large circle and outside a number of small circles 
about the poles contained in the large circle, the convergence will be 
uniform. 

It follows that, under these conditions, the limit in equation (224) will 
be approached uniformly for z in such a region. 

In particular, if f(w) is uniformly bounded on all the contours, we may 
take K n *= q f /M n . For this makes K n —> 0 a s n and hence M n —> oo. 

As an example, consider the function defined by 


f(z) = esc z -> for z 0, and /(0) = 0, 

z 


(227) 


so that /(0) is the limit of /(z) at the removable singularity at the 
origin. Then, for z = x + iy, 


|csc z| = 


\e'*~ v 


- e ~ lx+v \ ~ \e v - e~ 



|y| = i. 


(228) 


If we take as the contours, squares with center at the origin, sides paral¬ 
lel to the axes and passing through the points (n + \)-k, the relation just 
written gives an upper bound for the part of the contour with \y\ S 1. 
But, for the [part with \y\ g 1, since |csc z| has the peroid r, we have 
merely to take an upper bound for esc [ (ir/2) -f iy] for y in this range. 
Unity: is »uch a bound, since the reciprocal is 


&f 


am 




cos iy = cosh y 2* 1. 


(229) 
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Thus the expansion is valid for the function defined in (227). Since the 
poles are at the points n and at these 

lim (z — nr) esc m r = ( — l) n lim —r = (—l) n , (230) 

z—**n h — ►O sin h 


by equation (191) the residue at n is (—l) n . Since each contour brings 
in two additional poles, we have: 

esc z ~ = lim £' (-l) n I"— -h —1 • (231) 

Z p—*■« n~—p [Z — Tlir fl7T 


The prime means that the term for n = 0 is to be omitted. For the 
individual terms of the sum, 



\z — tit mr\ 


\mr(z — mr) 


2N 

nV 


. if \nir\ S 2\z\. (232) 


Consequently, in any finite region not including any of the poles as 
interior or boundary points, the corresponding infinite series converges 
absolutely, so that 

esc * - - + £' (-1)” T —— + -1 (233) 

z n *=i L~ — ntr n irj 


1 00 

= -+ L (-D re 


2z 


n\ 2 


(234) 


The second expression (234) follows directly from (231). The first 
expression (233), with the terms taken in any order that includes each 
one at some stage, equals the second because of the absolute convergence. 
By similar reasoning, we find that 


1 * 2z 

COti Z ~~ | ^ O n n 

Z 1 z — 71TT 

(235) 

= -+ £' [—?— + -]. 

Z n~ — x \jz — mr mr J 

(236) 


In any finite region not including any of the poles as interior or bound¬ 
ary points, the separate terms are analytic and the series (236) converges 
uniformly. Hence the series may be differentiated termwise to give: 


esc 2 z — 



1 

(z — nr) 2 


(237) 


286. The Infinite Product for the Sine. The function cot z — 1/z 
has a removable singularity at the origin. And, if we transpose the 1/z 
in equation (236), the origin may be included in the region of uniform 
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convergence. Hence, on any path in this region joining 0 and z , we may 
integrate termwise and obtain: 


or 


/[cot.-i]*- + 

Jq L 2J n»~00 t/o L z ~ ^7T 

log—= £' ["log (l - —") —1 

Z n «- * L \ nir/ nir J 


(238) 

(239) 


where the value of each logarithm is determined by continuation along 
the path from the value 0 for each logarithmic term at z = 0. For 
example, one determination is fixed if we require that the path never 
crosses the real axis and for real z is taken in the upper half plane. 

For any determination, when we take exponentials, we find: 



(240) 

(241) 


286. Analytic Functions of Several Complex Variables. We shall 
define a function of k complex variables as analytic in these variables if 
it has partial derivatives with respect to each of the k variables and if 
the function is continuous* in a certain region in the fc-dimensional com¬ 
plex, or 2fc-dimensional real space. We illustrate some of the extensions 
of the theory by treating the case of two complex variables. 

If/(^ i, 2 2 ) is analytic in the two variables, it is analytic in each of them 
taken separately. If C i and C 2 are circles about z x and z 2 in their respec¬ 
tive planes and the function is analytic in a region including that obtained 
by letting the variables range in their circles independently, we have by 
the Cauchy integral formula for functions of one variable: 


and 


/(z 1,22) 

/(*!,**) 


— f 

2m J ( 7 t t\ — Z\ 

J_ f 

ZTTl *s c t — z 2 


By combining these two equations we find : 

fM = ( 2 rifS Cl dh Sc,{h -Z1W2 - *a) dk ' (242) 

* For the Hartogs-Osgood proof that the continuity assumption is superfluous, 
II, pp. 180-198 of Osgood's Funktioneniheorie , — reference 19 of the bibliog¬ 
raphy. 
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Since the integrand may be developed in a double power series, which 
converges uniformly, we may show that an analytic function of two 
variables always has a power series development. Furthermore, the 
function possesses continuous derivatives of all orders and the coefficients 
of the power series are related to the derivatives by formulas similar to 
those for a Taylor’s series, for a function of two real variables. 

If we write j(z x ,z 2 ) = u + iv, where u and v are each functions of the 
four real variables x*, y u x 2 , y 2) we find 


bu bv bu bv 

bx x byi by i bxi 


(243) 


with similar formulas for the subscripts 2, in consequence of the Cauchy- 
Riemann differential equations and the fact that f(zi,z 2 ) is analytic in 
zi = x x + iy x . 

This enables us to show that, if t\ and t 2 are each analytic functions of 
Z\ and z 2j while w is an analytic function of t x and t 2 , then w is analytic in 
Zi and z 2 . We wish to show that, under the conditions stated, w has a 
derivative with respect to z x given by: 

bw 
bzi 


bw bti bw bt 2 
bt\ bz\ bt 2 bzi 


(244) 


If we put t x == r x + isi and t 2 = r 2 + is 2 , we have: 

dSi 


bw bt\ _ (b 
bt\ bzi \5 


+ i 


) 


(245) 


(bu .bv \ /dri 
\br x br x ) \bx x ' dx 

We may use the Cauchy-Riemann differential equations to transform the 
expansion of this into 

bs\ 


bu br i bu --x ^ ^ 

br x bx i bsi bx i 




bv br x bv 

jbr i bx i dsi 


(246) 


We may proceed similarly with the last term of equation (244). As 
the derivatives are continuous, u and v are differentiable, and by the 
method of totally differentiating functions of four real variables, we find 
that: 

bu bu br x 
bx i 

with a similar equation for bv/bx x . From these two equations and the 
transform of the terms in equation (244) given, for the first term, by the 
expression (246), we find that: 

bw bt\ bw bt 2 bu ( . bv /<iao\ 


bu bs x bu br 2 bu bs 2 

br x bxi bs x bx x br 2 bx i bs 2 bx\ 


(247) 
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But, by the Cauchy-Biemann differential equations, the expression 
(246) is equal to 

*L**L + + i“*lV f2 491 

dsi dyi dri dyi \dsi dy x dr x dy x ) 

Using this as the transform of the first term and the expression with 
1 * 1,61 changed to r 2 ,s 2 for the second term and the expansions correspond¬ 
ing to (247) with x replaced by y and then u,x replaced by v,y, we find: 


dw dt x dw dt 2 
dt x dz x dt 2 dz x 


dv . du 
dyi dy x 


(250) 


A comparison of equations (249) and (250) shows that 


du _ dv du dv 

dx x dy x dyi dx x 


(251) 


Since the partial derivatives are continuous and these are the Cauchy- 
Biemann equations, it follows that w is analytic in z lf and that dw/dzi 
equals the right member of equation (248), so that equation (244) holds, 
as we stated. 

A similar argument holds for z 2 and since the function w is continuous 
in Zi and 22 , as a continuous function of continuous functions, it follows 
that w , involving Z\ and z 2 through the functions t\ and t 2 , is analytic in 
Z\ and z 2 . 

These facts all extend to analytic functions of k complex variables. 
Such functions have derivatives of all orders and Taylor’s expansions. 
Also, any analytic function of analytic functions is again analytic and its 
derivatives may be computed by the same rule as that for the total 
differentiation of composite functions of real variables. 

One important difference between functions of one and of several 
complex variables is that the region of convergence of a power series in 
several variables may be much more complicated than that for one 
variable. 


EXERCISES xra 

1. If u + tv is an analytic function of z *» x + W, prove that u and v are 
each solutions of Laplace’s equation: 

Z+£. 0 . 


2 . In some simply connected region B, let u be a single-valued function which 
satisfies the equation of problem 1 . Show that, with the line integral taken 
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over any path in R from the fixed point a,b to the variable point x,y, 


£ ' y _du 
dy 


dx +T~ d V> 

OX 


is a single-valued function of (x,y) f independent of the path. Also show that 
u + iv is an analytic function of x + iy in R. 

3. Illustrate problem 2 for u = log(x 2 + y 2 ), with R the region obtained by 
removing one radius from a circle with center at the origin. This shows the 
necessity of the condition that R be simply connected, since u satisfies all the 
other conditions in the circle, with only the center removed. 

4. Formulate and prove a theorem on the analytic nature of u + iv, anal¬ 
ogous to that of problem 2, when v is a solution of Laplace's equation, and 


u 


l 


' x,v dv dv , 

— ax - dy. 

a,b dy dx 


by 


6. If z = re td and f(z) has a derivative, show that 



taking first AS = 0, and then Ar = 0. Hence show that 


du _ 1 dv ^ dv __ 1 du 

dr r 66 dr r 66 


6. Let q\ and q% be orthogonal curvilinear coordinates (compare problem 31 

of Exercises X) in the z plane, so numbered that - — is positive. Show 

d(x,y) 

that, if ds 2 * h\dq{ + h\dq\, and u + iv is an analytic function of z = x + iy, 
then 

1 du _ 1 dv ^ 1 du ^ 1 dv 

hi dqi dqz hi dq% hi dq\ 


Hint: For new x- and xj- axes, tangent to the curves of increasing qi and qz at the 

point, — = 0, — * i-, — ~ ~ > — = 0. Now transform the Cauchy- 

dx dy hz dx h dy 

Riemann equations for the new axes. 

7. Deduce the last equations of problem 5 from problem 6. 

8. Prove that if a power series £a n 3 n has for all a n , \a n \ n and for an 

infinite number |a n | 1 In, the radius of convergence is 1. 

9. Obtain the Taylor's series: 


(1 4* z) m * 1 + rnz 


m(m - 1) 0 , m(m - l)(m - 2) ^ , 
z 2 + -—- 2 s + 


2 ! 


3 I 


where m may be real or complex, and for \z\ < 1, the series represents the single¬ 
valued branch of (1 + z) m which is 1 for z ® 0. 
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10. Prove that the Bessel's function of integral order, 

A ( —py+2* 
n(Z) C5) 2-«**!(» +Jfc) ! ’ 

n zero or a positive integer, is a solution of the differential equation 


1 dw ( ?r\ 

+ ;* + V 1_ 5j"" 0 ' 


analytic for all finite values of z. 

11. Prove that Legendre’s polynomial of order n, 

P w _ f ( _ 1)t _ - m _ 

” *=o v 1 2 "Jfc! (n - *) ! (n - 2k) ! 

is a solution of the differential equation 
„ d 2 w dw 


(1 - 2 2 ; 


2 z— + n(?i + 1 )w — 0. 
dz 


12. Prove that the hypergeometric function 

w/ 7 \ , , al . a(a + l)b(b + 1) 2 , 

F(a,6;c; 2 ) = ! + -*+ JT^+IT ‘ + 


is a solution of the differential equation 

, d?w r , dw 

z(l-z)^+[c-(a + b+l)z} Tz 


abw = 0. 


The series converges by problem 21 of Exercises IX if \z\ < 1 and by section 282 
any analytic continuation from it will be a solution of the differential equation. 

13 . Let {c 2 — ci\ < r h the radius of convergence of a power series for f(z) in 
powers of z — C\ = Z\. If Z 2 = z — c 2 , then Z\ = Z 2 4- c 2 — ci. By using 
this to express the powers of Z\ as polynomials in Z 2 and collecting terms, we 
may formaily obtain a series in powers of z — c 2 , or Z 2 . Show that the infinite 
series giving the coefficients will converge, the new series will have a radius of 
convergence at least equal to n — |c 2 — C\\, and will represent f(z) at any point 
inside a circle of convergence for both series. 

14 . Show that the coefficient of Z\ in the series described in problem 13 is 
/ <W) (C 2 ) In ! and that the series represents an analytic continuation of f(z), if it 
converges in any region outside the circle of convergence of the first series. 

13 . Prove Abel’8 theorem: If a power series converges at any point on the circle 
of convergence, it converges uniformly on the radius drawn to that point and 
represent!^Continuous function on the radius. Hint: By putting 

(z - c)/(zi - c) « r, 

is reduced to discussing u n r n for 0 r ^ 1, with 2£w n con- 
;i^gent. Then the powers r n may be taken as the p„ of section 199, and the 
? ’i^tion (101) of that section shows that the remainder for u n r n is dominated 
by that for so that the convergence is uniform, and the continuity follows. 
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16. Prove that a power series may be integrated termwise along a radius out 
to z\ t on the circle of convergence, provided that the integrated series converges 
at z\. Hint: Use Abel’s theorem of problem 15 and section 168. 


17. The equation J, f(z) dz — F(z") — F(z f ) holds if F(z) is continuous 

on C and f(z) = F'(z) except at z", provided that f(z) is dominated by an 
integrable function on some arc of C which includes z ". A similar result holds 
for a path to infinity, with F{z") replaced by lim F(z), as 2 approaches z" on the 
path. Hint: Reason as in section 247. 

18. (Hardy) If ]£ a n z n converges for all finite values of z , for any j> > 0, the 
series ^e~ px a n x n may be integrated termwise from 0 to oo to give 22 a n n ! p“ n “S 
provided that the latter series converges. Hint: By the uniformity, termwise 
integration from 0 to M is permissible and the corresponding improper integral 
will converge to the series as stated if 

oo r fM 1 * 

22 a n n ! p~ n_1 — I a n e~ px x n dx —> 0, or 22 I a n e~ px x n dx —* 0. 

«= 0 L **0 J n =0 M 

r* 

By repeated integrations by parts, I a n e~ px x n dx = 

Jm 


Vn = a n n ! p~ n ~ 1 and S 


-( 


'M 

, . Mp . (My? , 
1 + 1 ! + 2 ! + 


VnS n , where 


+ 


(Mp) n \ . 


>) n \ 

~r 


-VM 


Since the S n increase (toward unity) with n, we may deduce 

| m+& 

22 Vn$n = Rm$m -f k ^ Fm f 

n --m 

by writing the sum backwards and using the Abel inequality of section 197, 
where R m is a bound for the remainder after m terms in 22 v n- But we may 
make R m small by a choice of w, since 22 v n converges and then with fixed m, 
make the first m terms v n S n small by taking M large, since for fixed n, as 
M —> oo, S n — > 0. Thus the result follows. 

J r 1 dz 11 

—— = 1 — - + ” — by using problem 16. 

0 1 +2 ^ o 

Compare Exercises IX, problem 10. 

20. lif(z) is analytic in and on a circle C about a with radius R and \ f(z)\ S M 
on C, then \f k (a)\ ^ k ! M/R k . Hint: Use sections 270 and 265. 

c(t) 


21. If c(t) is a function continuous on a curve C, the integral 


r c(t) 

Jet-> 


dt , in 


any simply connected region R containing no points of C, defines an analytic 
function of z. Note that C need not be closed, c{t) need not be analytic, the 
values need not approach a limit as we approach a point of C. For regions 
separated by C, distinct functions may be defined, as in problem 22. 

22 . Let f(z) be analytic on C } a closed curve and in the region bounded by C. 

m 


Show that 
side C . 


(l 

Jet 


dt equals 2 rif(z) if z is inside C and equals 0 when z is out- 
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S3, Let f(z) be analytic inside and on a closed curve C\ and g(z) be analytic 
inside and on a closed curve C 2 , lying outside of Ci. Show that 



equals/(s) for z inside C\ and g(z) for z inside C 2 . 

24. If f(z) and g( 1 /z) are each analytic for \z\ ^ 1 and C is the circle z — 1, 

then — ~ + -- J * equals f(z) for \z\ < 1 and equals g(z) for 

|s| > 1. This and problems 22 and 23 illustrate that a single simple “ expres¬ 
sion ” may define distinct analytic functions, that is, not obtainable from one 
another by continuation, in separated regions. 

23. Prove that the series 

1+z l+Z + Z 2 1 + 2 + Z 2 + Z 3 
1*2 2•3 * ^ ^ « 


defines an analytic function for \z\ < 1. 

26. Show that the series of problem 25 equals 1 — log (1 — z) for |z| < 1. 
Hint: Use the identity 

1 _ 1 1 

k{k + I) ~ k ~ k + 1 

to transform the series to 1 + z + — + - +* * *• 

27. If f(z) is single-valued and analytic for r\ g \z — a| r 2 and C f is the 
circle z — a * T\ (or r 2 ), in equation (174), the expansion of equation (173) 
represents f(z) for ri g \z — a\ ^ r 2 . 

28. If f(z) = 1 j{z — 5), the expansion of problem 27 is: 


and 


1 z — a (z — a) 2 (z — a) 3 

ft — a ~~ (6 — a) 2 ~ (ft"-'a)* ~ (6 - a) 4 1 

1 b - a (6 - a) 2 (6 - a) 3 

3 — a (z — a) 2 (* — a) 3 (2 — a) 4 ^ * 


if 

if 


\z — a| < \b — a|, 
|« — o| > )6 — a|. 


29. By differentiation termwise, deduce expansions for 1 /(z — ft)* from those 
for the first power in problem 28. These may be used to find the expansion for 
any rational function in a ring r\ < \z — a\ < r 2 including none of the poles. 
80. If f(z) has a pole of the mth order at a, the residue at a is 


evaluated at a. Compare section 116. 
‘A The series z + £** + §2* + • • • and 


-log 2 4 


2 + 1 


(z + 1 )’ 


+ 


(Z ± 1)» 
3-2* + 


2 


2-2 s 
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represent the same function in their common region of convergence, while the 
. . , ~ , (» - 2)2 (* - 2) 8 , , . . 
senes m — (z — 2 ) + —-— “ —g— + • • • has no region in common 

with the first series, but may be obtained from it by analytic continuation along 
a suitable path. 

32. If w «= f(z) is single-valued, while z — f~ l (w) is many-valued, its branch 

points must be among the points where/' (z) is not finite and distinct from zero. 
Hint: By section 259, when f'(z) 0, dw jdz — l//'(z), and the inverse func¬ 

tion is analytic. 

33. Use problem 32 to find possible branch points of tan -1 z and sin "” 1 z, by 
finding where the expression for the derivative ceases to be finite and distinct 
from zero and determine which are branch points. 

Ans. tan -1 z at i and —i; sin ” 1 z at 1 , — 1 and go . 

34. At a the function w = 2z + (z — a ) 4/3 has a branch point, although the 
expression for the derivative approaches 2 . There is no single-valued inverse 
function, so that the test of problems 32 and 33 does not apply. 

36. If f(z) has a zero or a pole at a, then f'(z) /f(z) has a simple pole and its 
residue is the order of the zero, or minus the order of the pole. Hint: Differ¬ 
entiate log/(z) = m log (z — a) + F(z), with F(z) analytic at a. 

36. If, except for poles inside C, f(z) is analytic inside and on C, and 9^ 0 on C, 

J f* /'(#) 

77-7 dz is always integral and equals the excess of zeros over poles inside C, 
c /(*) 

counting an mth order pole or zero m times. Hint: Use problem 35. 

37. If C is a circle about the origin of radius M and P(z) is a polynomial of the 

c rp'(z) 7i~i 

nth degree, prove that lim I —-r — - \dz = 0. It follows from prob- 

Af-*+-oo Jc L F(Z) Z J 

lem 36 that P(z) has n roots inside C, for M sufficiently large, which gives an 
alternative proof of the fundamental theorem of algebra. Hint: Reason as in 
section 280, noting that the integrand is rational, with denominator of higher 
degree than the numerator by at least two. 

sinmx 


38. Show that 


39. 


r 


J r»oo 
0 


o x(a 2 + x 2 ) 


dx * —: (1 - m ^ 0, a > 0. 


cos mx 


a 2 + x 


dx = 


7re 


2a 


■i: 


2a 2 
x sin mx 


dx 


ire 


, m > 0, a > 0. 


a 2 + x 2 2 

Hint: Use problem 38, and differentiate with respect to m. This illustrates 
that a combination of the method of residues with the devices illustrated in 
problems 29 through 37 of Exercises XII is often advantageous. 


J r»oo x -p 7J- 

—— dx = -- > 0 < p < 1. 

o 1 + x s mpr 

Hint: Integrate z~ p 1(1 + z) around a contour consisting of the positive real 
axis from h to M, a large circle of radius M about the origin, the real axis from 
M to h and a small circle of radius h about the origin. As ilf go , M ~ p —► 0, 
while as h—*0, h}~ p 0, so that the integrals on the two circles each —> 0. If 
I denotes the integral from h to M, using the positive real determination of x p t 
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the integral from M to h for the second line segment is — e~ 2piri 7, since the sense 
is reversed and going around the circle changes log z by 2? ri and so multiplies z p 
by e?PTi' i n the cut ring the only pole is at —1, and the residue is ( —l) p = 
e~ pvi . Hence, in the limit: (1 — er 2pTi )hs = 2me~ piri 


and 


h 


27 ri it 

e P*i _ e ~pvi s j n T p 


where Jo is the limit of I as M —> °o f k —* 0, or the given integral. 

41. Show that, for m and n integral, 



x 2n + 1 ^ = 


7T 


2 n sin 


2m + 1 
2 n 


-] 


, 0 ^ m < n. 


For m,n integral this is an example of section 280, but the result is more easily 
proved and for all real m,n with 0 < 2m + 1 < 2n by transforming the in¬ 
tegral of problem 40 by x — u 2n . 

42. Show that 



e qz 7r 

1 + e x sin qir 


>0< q< 1. 


Hint: Either put x = e u in the result of problem 40, or integrate around the 
rectangle y = 0, y = 2t, x = —R,x-R with R-* oo . This is essentially the 
image under w = log z of the contour used in problem 40. 

43. Show that 



X~ P — 

—-- dx = 7r[cot qir — cot p7r], 0<p<l,0<g<l. 


Hint: Integrate z~ p /(1 — z) around the contour of problem 40, with the seg¬ 
ments from 1 — h to 1 + h, and from 1 + h to 1 — h replaced by the upper and 
lower halves of a circle of radius h about 2 = 1 . Deduce that: 

(1 - e~ 2px ‘) YZT X dx + n( 1 + e~ 2p *') + T = 0, 


where T denotes terms which —> 0 when h—+ 0 and ilf . Then divide by 
(1 — e~~ 2piri ), subtract the corresponding equation with # in place of p and take 
the limit as h—>Q and M —■> a>. 

/ °° __ 

~- — dx — 7r(cot ttt — cot S7r), 0<r<l, 0 < s < 1. 

00 1 € 

Put a; = e u in the result of problem 43. 

45. Show that log (1 - 2p cos z + p 2 ) dx = 0, if -1 p ^ 1, and 

« 2tt log [p| if p £ — 1, or p 1. Hint.* The integral is 1 /2 that from 0 to 2w, 
and hence by equation (200), section 280, is 

1 f log (? — *) + log (pz — 1) - log 2 , 
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with C a circle of radius unity about z = 0. For 0 < p < 1, exclude a line 
joining 0 and p and for the logarithms, take arg (p — z) from — 2r to 0, 
arg (pz — 1) and arg z from 0 to 2i r. Then the numerator is real on C and 
single-valued in the slit circle. Hence the integral equals that around C', made 
up of a line from h to p — h, with values approached from below, a small circle 
C P of radius h around p, a line from p — h to h, with values approached from 
above and a small circle Co of radius h around P. Along C P the integral —> 0 
like h log h, as h—> 0, but log (p — z) is increased by 2iri. The other terms 
cancel for the h to p — h, and the p — h to h parts, but the increase gives 


i r h 

2i «/p— 


' h 2tti 
p-h Z 


dz = 7r[log h — log (p — &)]. 


Along Co we get ir log p from the term log (p — z) and ttH from log (pz — 1), by 

i r 

using residues. For — J 


—log z i 

—-— dz , we use the indefinite integral ~ (log z) 2 


with log z varying from log h to log h + 2t i, so that this term gives 

— 7r log h — 7r 2 i. 

The sum of the terms —» 0 when h —> 0. For p > 1, put p = 1 /q, 

log (1 — 2p cos x + p 2 ) = 2 log p + log (1 — 2 q cos x + q 2 ) 

and use the first result for the term in q. For p negative, put p = — q. For 
p = 1, deduce the continuity of the integral from the fact that the original inte¬ 
grand is dominated by an integrable function near x = 0 and converges uni¬ 
formly in any range from h to 7r. 

\/ 7r 


46. From 


x 


r 


‘ dx — 

V~r 


problem 32 of Exercises XII, deduce that 


e~** cos 2 bx dx — ~~ e -62 • Hint: Integrate e * 2 around a rectangle 
o 2 

bounded by y = 0, y = b } x — M, x = —M y with M —» oo, 

47. For 0 ^ A ^ tt /4, t real and varying from 0 to qc f the integral of e~* 2 dz 

4 yJ~i r 

with z == te tA is independent of A . From the value for A = 0, deduce two 

r V2tt 

cos x 2 dx = I sin x 2 dx = — “— • 
o Jo 4 

Hint : Integrate around a sector bounded by the lines for two values of A and 
a circle about the origin of radius M, with M —> oo. On the arc use equation 
(210) as for (211). This and problem 46 illustrate how contour integration 
sometimes enables us to deduce one definite integral from another. 


48. Prove that cos z 


4z 2 1 

II 1 - —- rrn • Hint: Justify the regroup- 

n« lL (2n - l) 2 7r 2 J 


ing in the product for sin (z + tt/2). 
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48. Prove that cos - cos ^ cos ^ • • • = ■ Hint: Use problem 48, or 

z z z 

sin 2 = 2 sin - cos - and — sin — —> 1 . 

2 Z Z £ 

1 Z 1 Z 1 Z 1 

60. ~tan- + ^ tan ^ ^ tan ^5 + • • • = - — cot z. Hint: Use problem 

49, take logarithms, and differentiate. 

61. If 0 < \z\ < ir, and Hu = 1 + ^ ^ H - , prove that: 


log — = H 2 —; 2 + ~H 4 —+ H e+ 

Sm Z ir* 9. nr* 3 nr* 


and 


1 * 

cot z -- — 2H 2 ~ 

Z 7T 


2H4 


It will be shown in section 320 that 


-2 H u (-D‘2 2 * 


r* * 


Bzk, where the # 2 n are 


tt ak (2k) ! 

Bernoulli numbers. Compare problems 3 and 8 of Exercises XVI. 

62. If u + iv is an analytic function of z = x + iy at z 0 = x Q + iy 0 , then u 
and v are each analytic functions of the two variables x and y for x - x 0 , 
y * j/o. Hint: Put (z — z Q ) = (x — x 0 ) + i(y — 2 / 0 ) in the series in powers of 
(z — zq) and deduce convergent power series in powers of (x — x 0 ), (y — y 0 ). 

63. If, for/, x,y real, f(x,y) is a solution of Laplace’s equation of problem 1 in 
some two dimensional region including x 0l y 0 as an interior point, f(x,y) is an 
analytic function of x and y at xo,yo. Hence it has partial derivatives of all 
orders and a power series representation about this point. Hint: Use problems 
2 and 52. 

64. Let u(x t y) and v(x,y) be each real for x and y real and analytic in x and y 
for x « xo, y « yo. If w * u + iv, the equations z = x + iy and z — x — iy 
or x * (z + 5)/2, y » (z — S)/2i determine w as an analytic function of z and 5. 
This will be a function of z alone if dwf dl *= 0. Show that, for real values of x and 
y this condition is equivalent to the Cauchy-Riemann differential equations (8). 
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FOURIER SERIES AND INTEGRALS 

On any circle inside and concentric with the circle of convergence of a 
power series, the real and imaginary components of the analytic function 
represented by the series are each real, periodic functions of the angular 
codrdinate. On such a circle, the power series representation of the 
analytic function leads to a series expansion for each of these periodic 
functions in terms of sines and cosines of multiples of the angular 
coordinate. This suggests the possibility of expanding other periodic 
functions in a series of sines and cosines, or in a Fourier series. We shall 
study this question, and derive a few of the simpler sufficient conditions 
for a function to admit of such a representation. 

The Fourier series may be thought of as representing a given periodic 
function for all values, or in any interval of length one period as repre¬ 
senting a function merely given in that period. There is an analogous 
representation for functions given on an infinite interval, involving an 
integral in place of a sum, the Fourier integral. We derive a sufficient 
condition for this representation, applicable to functions which approach 
zero at infinity in a suitable way. 

287. Fourier Series of Periodic Functions. If the power series 
£a n z n converges for all z with \z\ = r and the sum function is F(z), we 
have: 

F(re ie ) » X) a n (rt i6 ) n . (1) 

n=0 

If we decompose the function on the left and the coefficients a n into 
their real and imaginary parts, 

F(re iB ) * P(0) + iQ(9) and a n = p n + iq ny (2) 

we find as a consequence of equation (1) that: 

00 

P(6) » £ ( p n r n cos n$ — q n r n sin nd ), (3) 

o 

and 

00 

Q(6) = £ (q„r n cos nd + p n r n sin nd). (4) 

n« 0 

The functions P(6) and Q(6) are each real functions of 6 f of period 2ir 
and the equations just written show that certain periodic functions of a 
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special nature admit of a representation by a series of sines and cosines 
of multiples of the variable. Similar expansions may be derived from 
Laurent series, containing negative powers, as in problem 13 of Exer¬ 
cises XIV. The question naturally arises whether periodic functions of 
more general character admit of such expansions. 

If we use the period T, instead of 2 w, we must form the series from the 
terms cos u(2t/T)x and sin n{2ir/T)x, since each of these has the period 
T. In fact any finite sum or convergent series 


iUn 

»-l \ 


2wnx _ . 2 wnx^ 

cos —-h B n sin - .— 

T T j 


will represent a function of period T. 

Now let us start with a function/(x), of period T and assume that it 
can be expressed as the sum of a series of the form (5). If it is permissi¬ 
ble to integrate the series termwise, we must have: 

J /(x) dx = AT, and A = ~ f f(x) dx, (6) 

0 i «/() 


since for n a positive integer, 


2ir nx 

cos dx « 0 and 
T 


f* 

Jq 


. 27rnx 
sin —— dx 
T 


Next let us multiply each term of the series (5) by cos n(2TtT/x). 
Then if this series may be integrated termwise, it follows that: 


2 C r 

An =TJo f(X) 


since, for m and n each a positive integer, 


P 

Jo 


, 2irmx 2tt7ix 
sin —— cos ~y~ dx = 0, 


2irmx 2rnx , 

cos — cos —— dx = 0, m ^ n, 


, 2irnx , 

3 — ■ — - dx 


Similarly, if the series obtained by multiplication by sin n(2rT/x) may 
be integrated termwise, it follows that: 


2 C T 2ttix 

Bn ~Tj 0 f^ sin ~jT dx > 



Art. 288] 


FUNCTIONS OF PERIOD 2 w 


477 


in view of equation (9) together with 

. 2tt mx . 2t nx , 
sin —sin dx 
'o 


/’ 

«/o 


/ 
«/ n 


T 

, 27rnx 


0, m n, 


sin" 


, r 

dx — —) 
2 


(13) 

(14) 


where m and n are each a positive integer. 

For any function /(x), of period T, for which the integrals exist, we 
define the constants A, A n , B n given by equations (6), (8) and (12) as 
the Fourier coefficients of the function fix). We write: 


fix) ~ A + 


i (a. 

n = l \ 


27 mx . 2rnx\ 

COS -y- + B n Sin — 


y 


(15) 


and speak of the right member as the Fourier series for/( x ), whether the 
series converges or not. If the series is known to converge to f(x) } we 
may replace the sign of equivalence, by the equality sign. 

We also form the finite sums: 

Sn = A + p ( A k cos ~Y~ + B n sm ~^r) 9 (16) 


which we call the partial sums of the Fourier series for / (x). 

We note that for a function of period T 7 , we may use any interval of 
length T 7 , as a to a + 7 7 , in place of 0, T in calcuating the integrals which 
appear in the formulas for the coefficients. Thus these coefficients may 
be defined by 

A = the average of f(x), 


A n - twice the average of f{x) cos > 

(17) 

I-. c ? / \ • 27rnx 

B n = twice the average of fix) sin —— > 

with all averages taken over any interval of length T. 

288. Functions of Period 2ir. When the period T is 2t, the factor 
2ir/T is unity and so may be omitted. Moreover, there is no real loss 
of generality in restricting ourselves to this case, since if we have any 
function fix) of period T , and we write: 


*-(?)* /W-/(f)-TO, 


(18) 
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the function F(X) is of period 2x. Also the Fourier coefficients of the 
function F(X), regarded as a function of period 2ir are the same as the 
Fourier coefficients of the function fix) regarded as a function of period 
T, since averages are not changed by a change of scale. Consequently, 

F(X) ~ A + Z (A n cos nX + B n sin nX), (19) 

n*l 

is equivalent to the relation (15), and the series of (15) will converge to 
/(x) if the series of (19) converges to F(X). 

Accordingly, to simplify the writing, from now on we shall consider 
T «* 2tr, but shall continue to use x as the variable and /(x) as the 
function. 

289. The Partial Sums. The partial sums are: 

n —1 

S n = A 4- 22 (A* cos kx + B k sin k: r). (20) 

t-i 

Using the definition (17), we may consider the coefficients defined by: 



1 r T+x 

A n = - / fit) cos nldt, (22) 

ir J- r + x 

1 r T+z 

B n = - I f{t) sin nt dt. (23) 

*■ J-T+Z 


In these equations we think of x as a particular value under considera¬ 
tion and to avoid confusion we have replaced the dummy variable of 
integration by t. 

We find: 


At cos kx + B\ sin kx 


j 

-I j{t) (cos kt cos kx + sin kt sin kx) dt 
- I f(t) cos k(t — x) dt. 

7T 


Consequently, 


*•+$ r i n~l 

' - + £ cos k(t — x) 




Ls 


k-l 


fit) dt. 


If we change the variable by putting t *= x + u, this becomes 

1 r w 

(, Sn 3 * ~ I *»(«)/(* + U) du, 

r «/_, 


(24) 

(25) 


(26) 
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where 


s„(u) 


1 B —1 

- + £ cos feu = 

2 k=\ 



(27) 


That the last term is the sum of the series follows by mathematical 
induction from the identity: 


sin (k + ^ u — sin (k — ^ u = 2 sin ^ cos feu. 


(28) 


Since the function s n ( u ) is an even function, we find on separating the 
range — ir to w into — x to 0 and 0 to ir that: 

S„ = - f s„(u)[f(x + u ) + /(x - u)] du. (29) 

7T J o 

From the sum for s n (u) in equation (27), we may deduce that 
1 r r 1 

- I s„(u) du = -• (30) 

7T t/0 Z 

290. A Transformation of the Limit. We shall write: 

/(xi + ) = lim /(x) and f(xi~) - lim /(x), (31) 

X —►Jv'f X —►Xi— 

to denote the right- and left-hand limits introduced in section 30 and 
shall confine our attention to points for which both these limits exist. 
At such points we seek a condition for the Fourier series of the function 
to converge to 

0(x) = £[/(*+)+/(*-)). (32) 


In particular, at a point where/(x) is continuous, 

/(*+)=/(*-) =/(*)> and ff(x)=/(x), (33) 

so that the condition will be one for the convergence of the series to/(x) 
if x is a point of continuity of the function. 

From the definition of a partial sum, the series will converge to g(x) if 

g(x) = lim S n = lim - f s„(u)[/(x + u) +/(x - u)]du. (34) 


But, in consequence of the relation (30), we have: 

i r* 

g(x) = lim - I s„(u)2g(x) du. (35) 

c© 7T c/q 
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Thus the series will converge to g(x) if, and only if, 

lim f s n (u)[f(x + u ) +f(x — u) — 2g(x)] du - 0. (36) 

291. Riemann’s Theorem. In those eases where we can prove that 
the integral just written approaches zero, we make use of the presence 
of the factor sin (n — 1/2 )u in s n (u). This factor enables us to simplify 
our problem because of the fact that, if F(x) is a function possessing a 
finite proper or absolutely convergent improper Riemann integral , then for 
m real but not necessarily an integer . 

lim f F(x) sin mx dx = 0. (37) 

m—**oo «/ 0 


We devote this section to proving this theorem, originally due to 
Riemann and generalized for the improper case by Lebesgue. 

We first observe that the relation is true if F(x) is a constant, since 


r b 


,, cos ma — cos mb 

1 K sin mx dx 

= 

K - 

J a 


m 


2\K\ 


m 


(38) 


Consider next a step function, S (x), in the interval a, b; that is a func¬ 
tion constant in each of a finite number of subintervals which, like those 
used in defining the Riemann integral, make up the entire interval a, b. 
The function is constant in the open intervals. Its value at the end 
points is of no consequence since these are finite in number and will not 
affect the integral of the function. If the function S(x) is such that M 
is a bound for |£(x)| and there are k steps, it follows from equation (38), 
applied to each subinterval, that: 

* b 2 kM 

S(x) sin mx dx g- (39) 


f 


m 


This approaches zero when m —> oo f so that the result holds for a step 
function. 


Finally, we note that for any proper Riemann 


integral, /n*> dx, 


the method of defining the integral shows that there is a step function 
S(x) such that 



\F(x) - S(x )| 


dx < €. 


(40) 


In fact, for a step function used in a lower sum, the integral just written 
reduces excess of the Riemann integral over the lower sum. 
Tbesttme result holds for an absolutely convergent improper Riemann 
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integral, since such an integral may have its range of integration sepa¬ 
rated into that for a proper integral and a number of intervals on which 
F(x) is unbounded, but such that the integral of \F(x) \ over these inte¬ 
grals is arbitrarily small, say < e. Thus we may take S (x) as in equation 
(40) for the range of the proper integral and S(x) =0 on the remaining 
intervals. It will result that: 

j*\F(x) - S(x)\dx <2e. (41) 

If we start with c/2 in place of c, this is the relation (40). 

Now consider 


J F(x) si 


sin mx dx 


J* S(x) sin mx dx 

= J J* [F(x) — >S(x)] sin mx dx 

~ S ~~ * l S * n 

^ J \F(x) - S(x)\dxg€. 


By the relation (39), for m sufficiently large, 


J S(x) si 


sin mx dx < c, m > m 0 . 


Consequently, from the last two relations, 


| J* F(x) sin mx dx < 2c, for m > mo. (44) 

This proves that, as m —► « the integral approaches zero, as stated in 
equation (37). 

With the same conditions on F(x) and m, the argument shows that: 


/V(x) 


cos mx dx = 0. 


292. Conditions for Convergence. In equation (36), the factor 


s„(u) = sin (n - 0m — 
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liSis any positive number leas than r, the function 1/ sin (u/2) is con¬ 
tinuous and bounded in the interval S,r. Hence 

F(w) = [f(x + u) +f(x — u) — 2g(x)] —-— (47) 

_ . u 
2 sin - 
2 


will have a proper, or absolutely convergent improper, integral with 
respect to u on the interval 5,x if, as we shall assume, f{u) has an integral 
of this type on any finite interval. 

Hence we may apply the Riemann theorem of the last section to prove 
that: 


lim f s n (u)[f(x + w) + f(x — u) — 2g{x)] du 

»*—►» VJ 

= lim f F(u) sin (n — udu — 0. (48) 

n—►« t/j \ 2/ 


This enables us to reduce the investigation of the integral of equation 
(36) to that for the interval 0,5. 

Again, we have: 


• ( l \ 
sin 1 1 n — - 1 u 


sm 


u 


= sin nu cot - — cos nu, 

z 


(49) 


and in the interval 0,5 we may apply equation (46) with 
2 F(u) = f{x + u) + f{x — u) — 2gix), 


(50) 


so that the part of the integral involving cos nu has a limit zero and the 
expression to be investigated is: 


to i/- 


u 

sin nu cot ~ [f(x + u) + f(x 
Z 


u) — 2 g(x)] du. (51) 


For 0 < u < 2^r, the factor cot u/2 is analytic and 


cot 


u 


U m U‘ 

"i * 8 


2 


,3 


. U U U 

sin -- 

2 2 48 


2 --Uau> + 

u 6 


(52) 


the Laurent expansion of section 276. Hence the function 

u 2 
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and if we use this limiting value at 0, the function is continuous for 
0 g « < 2ir. Consequently, for the interval 0 i£ u g 5, 


F(u) 




+ u ) + f(x - u) - 2g{x)\ 


(54) 


will have a proper, or absolutely convergent improper integral and by 
equation (37), 

lim / sin nu F(u) du = 0. (55) 

«—► oo J o 

Since the value, or indeterminate nature, of an integrand at a single 
point does not affect the integral, we may subtract this integral from the 
integral in the expression (51), and write the result: 

lim f — — [/ {x + u) +f(x - u) - 2 g(x)] du. (56) 

n —%/ o U 

The relation (36) will hold if this limit is zero. If f(x) is of period 2r 
and has a proper or absolutely convergent improper integral on the 
interval 0,27r, it will have an integral of this type on any finite interval. 
Also the integrals defining the Fourier coefficients will necessarily exist. 
Our discussion shows that, for such a function, a necessary and sufficient 
condition for its Fourier series to converge to the value g(x) is that for some 
'positive number 8 , the limit (56) exists and equals zero. The limit zero for 
any 5 implies convergence, while convergence implies the limit zero for all 
positive 8. 

293. Sufficient Conditions. Let us now seek a sufficient condition 
for the limit (56) to be zero, where g(x) has the form given in equation 
(32). If we require that 

lim f‘ 2^ [/(X + u) - /(*+)] du = 0, (57) 

W—*80 Jq U 

and 

lim f* 8 -^ [/(x - «) - f(x- )] du = 0, (58) 

n—*• oo «/Q U 

it will follow by addition that the expression (56) approaches zero. In 
particular, if 

|/(x+u) —/(*+)] ^ Ku p , where p > 0, for 0 < u < uq, (59) 
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we shall have, for h < u 0 , 

I r -f M ) - /( x )] dJ g f I f(x + u) - /(x+)| du 

g f Ku p ~ l du g - h p . (60) 

Jo P 

In the interval h to S, the integral of equation (57) approaches zero by the 
Riemann theorem. Thus we have: 


lim f 

n—■►co d o 


sin nu 
u 


[f(x + u ) - f(x+)]dv 


A*. 

V 


(61) 


Since K and p are fixed and p is positive, this may be made arbitrarily 
small by taking h sufficiently small. Thus the upper limit, being posi¬ 
tive or zero, must be zero; and the limit is zero as we wished to prove. 

The relation (59) is described as a Lipschitz condition to the right of 
order p. Similarly the condition 


| fix — u ) — /(x — )| g Ku p , where p > 0, for u 0) (62) 

is described as a Lipschitz condition to the left of order p. If this holds, 
the reasoning just used shows that equation (58) will follow. If the 
function is continuous, and such conditions hold on both sides, we have 

| fix + u) — fix) | ^ K\u\ p t where p > 0, for ~~u 0 S u S Uq, (63) 

and we say that the function satisfies a Lipschitz condition of order p at 
the point x. 

The most important case is that when p = 1, in equation (63), to 
which we have already referred in sections 128 and 255, w r here the con¬ 
dition held at all points of an interval. From the definition of a deriva¬ 
tive as a limit, it follows that the condition (63) holds with p = 1, 
whenever f(x) has a finite derivative at x. This leads us to our first 
sufficient condition for the convergence of a Fourier series: 

The Fourier series converges to the function f (x) at any point where f (x) 
has a finite derivative . 

More generally, the series converges to [/(x+) + /(x-~)]/2 if f(x) 
has a finite right-hand and a finite left-hand derivative, or satisfies a 
Lipschitz condition to the right and to the left of any positive order. 

To develop a second condition, suppose that /(x) is monotonically 
decreasing in the interval x to x + uq. Then the function 

<t>(u) * - f(x + u) +/(x+) (64) 

apfffWhes zero for u —»0 and monotonically increases in the interval 0 
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to h f h < Uq, so that it is positive in this interval. Thus we may apply 
the Bonnet mean value theorem of section 198 to obtain: 

sin nu , N (* h sin nu 

4>(u) - du = I - du , (65) 

o u u 

for a suitably chosen value of £ in the interval 0 ,h. 

From the properties of sin nu and the decreasing character of 1/u, it 
follows that the series: 


J " /n Bin nu r 2r/n sin nu , 

- du + I - du + 

o u J x/n u 


( 66 ) 


is an alternating series and so the sum of this series to any number of 
terms never exceeds the first term in numerical value. In fact, since 
each of the integrands preserves its sign in the interval corresponding to 
any one term, for any two positive numbers £ and ft, 



J r ' 7r/n sin nu 
o u 


du 2j£ 



(67) 


Thus the integral in the right member of equation (65) admits a bound 
independent of n and ft. Since it is multiplied by <t>(h ), which —»0 when 
ft —►0, the product may be made small by taking ft small. Hence the 
integral in the left member of equation (65) is numerically small, for h 
sufficiently small. By combining this fact with the Riemann theorem 
and using upper limits as we did for equation (61), we may prove that 
under the conditions stated, the limiting relation (57) holds. 

For f(x) monotonically increasing, we may use the same argument 
with f(x) replaced by its negative in the equation which defines <£(w). 
The reasoning also applies to the relation (58), if the function is mono¬ 
tonic in the interval x — uo to x. Thus the Fourier series converges at 
any point which separates two open intervals in each of which f(x) is 
monotonic and bounded. The Fourier series will converge for the sum 
of two functions if it converges for each of them. Since w r e proved in 
section 159 that any function of bounded variation in an interval can be 
decomposed into the sum of two monotonic functions, it follows that: 

The Fourier series for a function J(x) wiU converge to 


iLf(x+) +/(*-)] 


for any value x, in some interval in which the function /(x) is of bounded 
variation . (Jordan.) 

294, Uniform Convergence. Since each of the terms of a Fourier 
series is a continuous function, if the series converges uniformly for all 
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values, or for all values in some interval, the sum function f(x) will have 
to be continuous for all values, or for all values in the interval. 

If the sum function/(#) is of bounded variation throughout an inter¬ 
val and is continuous throughout this interval, then the Fourier series 
will converge uniformly in any subinterval of this interval. Again, if 
the sum function/(x) has a finite derivative, uniformly bounded at all 
points of an interval, the Fourier series will converge uniformly in any 
subinterval of this interval. A similar result follows if a Lipschitz 
condition of positive order p holds at all points of an interval, with the same 
constants K and u 0 for all points of the interval. This results from the 
fact, that the number of terms necessary to achieve a given degree of 
approximation depends on the Riemann theorem and on the magnitude 
of h in such formulas as (61) and (65) necessary to make these terms 
small. When the function is continuous in a closed subinterval, as 
follows from any of the conditions stated, it results from the uniform 
continuity that the size of h can be fixed so as to do for all the points of 
this subinterval. This leads to a minimum value of h , so that the func¬ 
tions F(x ) to which we apply the Riemann theorem have the form 
f(x + u)/v,j for an interval h to 6, or at least may be made up of a sum 
of such terms. The function / (x) may be approximated by a step func¬ 
tion S(x) in such a way that the relation (40) holds for the interval 0 to 
2ir, or, from the periodicity, for any interval of length less than 2ir. 
Again, in the interval h to b, the function 1/u is continuous and may be 
approximated uniformly by a second step function T(u). If S(x) has $ 
steps in the interval 0 ^ x ^ 2r } and T{u) has t steps, the function 
S(x + u)T{u) will have at most st steps for h u <5 6. Hence the 
factor k in equation (39), due to the number of steps, will not exceed st 
and so will not disturb the uniformity. Similarly, the factor 
cot u/2 — 2/u is uniformly continuous for 0 g u S ir and hence for 
h :g u g 6, so that its presence in equation (54) will not disturb the 
uniformity. 

295. The Fejer Theorem. While continuity of itself is not a suf¬ 
ficient condition for the convergence of a Fourier series, there is a 
generalized process of summation by which we may get back the function 
from the partial sums. If, in place of the partial sums of a series, we use 
the first Ces&ro sums: 

Cl = Si, C 2 - , Cn = -i s k , (68) 

2 n *.i 

we say that the series is summable to a value/(x) in the sense of Ces&ro, 
or summable (Cl), if 

f(x) - lim C„. 

*•, n-*K 


(69) 
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We note that if a series is convergent, it is summable in this sense. 
For, if L is the sum, for any positive e there is an N such that if k > N, 
all the sums Sk will be between L — € and L + e. Thus, for n = N + m, 
we shall have: 

NC n + mL — me ^ (N + m)C n g NC n + mL + me. (70) 

If we divide all the terms by m and let m —> <*>, we may conclude from 
this that: 

L — e lim C n L -f- e, (71) 


with a similar relation for lim. From this and the fact that e is arbitrary, 
we have: 

lim C n = L. (72) 


This proves that a convergent series is summable in the sense of Cesdro to 
the sum to which it converges. 

However, a series may be summable in the sense of Cesaro without 
being convergent. Thus, for 

1 — 1-hl — 1H -, (73) 

the sums are: 

Si = 1, 0, 1, 0, - ■ • , 1, 0, • • • (74) 


and 


„ 12 13 

Ci = 2 * 3 * 2* 5 * 


? 2 n - 1 2 


(75) 


so that the series is summable (Cl) to 1/2. 

Let us now apply the process of Cesaro summation to a Fourier series, 
where we regard the (n + l)st term as 04 n cos nx + B n sin nx) } so that 
the sum of the first n terms is the S n given by equation (20), or (29): 



s„ = - f Sn(u)[f{x + u ) +f(x - «)] du, 

(76) 


TT Jq 


with 

, \ sin (n - |) u 1 , "^v 1 , 

s„ (w) — — „ + 2m cos ku. 

. u 2 t-i 

2 sin - 
2 

(77) 


We wish to calculate 

Cn - - £ S k . (78) 

n k—\ 


We begin by evaluating the sum for the only factor involving jfc, 

. <>nu 


£ sin (k — |) u 


1 — cos nu 


sin 


2 sin 


u 


. u 
sin - 
2 


(79) 
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values, or for all values in some interval, the sum function/(x) will have 
to be continuous for all values, or for all values in the interval. 

If the sum function /(#) is of bounded variation throughout an inter¬ 
val and is continuous throughout this interval, then the Fourier series 
will converge uniformly in any subinterval of this interval. Again, if 
the sum function f(x ) has a finite derivative, uniformly bounded at all 
points of an interval, the Fourier series will converge uniformly in any 
subinterval of this interval. A similar result follows if a Lipschitz 
condition of positive order p holds at all points of an interval, with the same 
constants K and u 0 for all points of the interval. This results from the 
fact, that the number of terms necessary to achieve a given degree of 
approximation depends on the Riemann theorem and on the magnitude 
of h in such formulas as (61) and (65) necessary to make these terms 
small. When the function is continuous in a closed subinterval, as 
follows from any of the conditions stated, it results from the uniform 
continuity that the size of h can be fixed so as to do for all the points of 
this subinterval. This leads to a minimum value of A, so that the func¬ 
tions F(x) to which we apply the Riemann theorem have the form 
f(x + u)/u , for an interval A to 6, or at least may be made up of a sum 
of such terms. The function /( x ) may be approximated by a step func¬ 
tion S{x) in such a way that the relation (40) holds for the interval 0 to 
2tt } or, from the periodicity, for any interval of length less than 2i r. 
Again, in the interval A to 5, the function l/u is continuous and may be 
approximated uniformly by a second step function T(u ). If S(x) has $ 
steps in the interval 0 S % ^ 27r, and T(u ) has t steps, the function 
S(x + u)T{u) will have at most st steps for A g u g b. Hence the 
factor k in equation (39), due to the number of steps, will not exceed st 
and so will not disturb the uniformity. Similarly, the factor 
cot u/2 — 2/u is uniformly continuous for 0 S u ^ ir and hence for 
h S u =£ b, so that its presence in equation (54) will not disturb the 
uniformity. 

296. The Fejer Theorem. While continuity of itself is not a suf¬ 
ficient condition for the convergence of a Fourier series, there is a 
generalized process of summation by which we may get back the function 
from the partial sums. If, in place of the partial sums of a series, we use 
the first Ces&ro sums: 

C, = 8 lt C 2 = , C„ - - £ S k , (68) 

we say that the series is summable to a value/(x) in the sense of Ces&ro, 
or summable (Cl), if 


/(x) = lim C n . 


(69) 
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We note that if a series is convergent, it is summable in this sense. 
For, if L is the sum, for any positive e there is an N such that if k > N, 
all the sums Sk will be between L — e and L + e. Thus, for n ~ N + m t 
we shall have: 


NC n + mL — me ^ (N + m)C n ^ NC n + mL + me. (70) 

If we divide all the terms by m and let m—+ 9 we may conclude from 

this that: 

L-egiimC^L + e, (71) 


with a similar relation for lim. From this and the fact that e is arbitrary, 
we have: 

lim C n = L. (72) 

This proves that a convergent series is summable in the sense of Cesdro to 
the sum to which it converges. 

However, a series may be summable in the sense of Cesaro without 
being convergent. Thus, for 

1 — 1 + 1 — 1H-, (73) 

the sums are: 

Si = 1 , 0, 1 , 0, • * • , 1, 0, • • - (74) 


and 


r 12 13 
Ci = U 2 9 3 ? 2’ 5 f 


’ 2n - 1 2 


(75) 


so that the series is summable (Cl) to 1/2. 

Let us now apply the process of Ces&ro summation to a Fourier series, 
where we regard the (n + l)st term as (A n cos nx + B n sin nx) f so that 
the sum of the first n terms is the S n given by equation (20), or (29): 


Sn = - f 8 n (u)[f(x + u) + f(x - u)] du , 
* Jo 


with 

We wish to calculate 


Sn (u) = —a l? = ~ + ”£ cos ku. 

, U 2 * = 1 

2sm- 


C» 


l ” 

- L s k . 

n k=x 


We begin by evaluating the sum for the only factor involving k } 


£ sin (fc — |) u 

A»1 


. o nu 

. sin J — 

1 — cos nu 2 


2 sin 


u 


u 


sm 


(76) 

(77) 


(78) 


(79) 
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The first form is proved by mathematical induction and the use of the 
identity: 


—cos (k + 1) w + cos ku = 2 sin ^ u sin ^ • 

It follows from the second form that 

. „ nu 


sin* —, 


Cn = j_r_in 

" nirJn . o u L 

sur- 


'f(x + u) + f{x - u) 


du. 


(80) 


(81) 


We also note, from the last expression of equation (77) and equation 
(79) that: 

nu 


an* 


n 


« —1 


= — + 22 ( n ~ k) cos ku, 


2 sin' 


2 « 2 *-i 


(82) 


so that 


nir 


f 

V 0 


sur 


, nu 


du =* 1. 


(83) 


sin 


2 _ 


Now consider a function f(x), of period 2t and continuous for all 
values. For any positive e, there is a 5 such that 

|/(z + «) -J{x) I < e, if \u\ <> 3. (84) 

From equations (81) and (83), we have: 

, nu 


sur — _ 

c n -m~— r —in 

nr Jq , 2 u 
sm 2 r 


’f(x + u) -f f(x ~ u) 


-/(*) 


du. (85) 


Let us separate the interval of integration 0,r into 0,6 and 6,ir. In 
i&f first interval, by equation (84), the last factor is numerically less than 
|ib that the contribution to the expression on the right for this interval 
t not exceed: 


. nu 
.sur — 


r —1 

0 . * w 

sur- 


du. 


( 86 ) 
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Since the integrand is positive, this is less than the result when we replace 
the upper limit by it. Thus, in view of equation (83), we find: 

h < *. (87) 

In the interval 5,it we have sin 2 (nw/2) is at most unity, and 


Thus, if M is such that 


sin' 4 - > sin* 


8 

2 * 


|/(x) | ^ M , for all x, 


( 88 ) 

(89) 


we have for the contribution from the second interval a quantity 
numerically at most: 


h 



du 



(90) 


where K is a constant independent of n. 

This proves that: 

\Cn~f(x)\ <« + -• (91) 

n 


For n > K/i, the right member is less than 2e, and hence: 

lim C n = /(x). (92) 

Since a function continuous on the closed interval 0,2ir is uniformly 
continuous, the quantity 5 may be chosen independently of x, so that the 
same is true of K and hence K/t. This proves that the convergence of 
the sequence C„ is uniform. 

We have proved one form of Fejdr’s theorem: 

The first Cesdro sums for the Fourier series of a continuous periodic func¬ 
tion converge uniformly to the function. 

296. The Weierstrass Approximation Theorem. This theorem 
asserts that any function, continuous on a closed interval, may be uni¬ 
formly approximated in this interval by a polynomial. We may easily 
deduce it from the theorem just proved. For, by a change of scale, the 
interval may be made less than 2r. And, by combining the function 
with a suitable first degree function joining the point b, f(b) with 
a + 2ir, f(a), we may define a function c(x), continuous and of period 
2ir, which equals/(x) in the interval a g x g b. Then, by the Fejdr 
theorem, there is a Ces&ro sum C„ such that: 

|c(x) - <?»(*) | < «, 


for all x. 


(93) 
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But the sum C n (x) was obtained from sums S n (x), each of which was 
a combination of constants and terms of the form sin kx and cos kx, 
with k at most n — 1. Thus the sum C„ (x) has the form: 

n —1 

C„(x) = A ' + (A^ k cos kx + sin kx). (94) 

1 

There are 2n — 2 < 2n trigonometric terms. If G is an upper bound for 
the numerical value of the coefficients, we may approximate each 
trigonometric function by a polynomial to within e/2 Gn. In fact, the 
Taylor’s series for sin kx and cos kx converge for all values of x and uni¬ 
formly on any finite interval, a g x g b. Hence we may carry out these 
series to a point where the partial sums furnish an approximation to the 
desired accuracy. When this is done with all the terms and these 
polynomials are combined, we have a polynomial P(x) such that 

\C n (x) - P(x) | < €, (95) 

In view of the relations (93) and (95), 

|c(x) — P(x )I < 2e, a ^ x g b. (96) 

This shows the existence of a polynomial uniformly approximating c(x) 
to within 2c, an arbitrary positive quantity. 

297. Convergence in the Mean. Let/(x) be a real periodic function 
for which the Fourier coefficients exist, and let the function [/(x)] 2 be 
integrable in the interval 0 to 2ir. Now consider any trigonometric sum 
of order n — 1: 


n — 1 

r„(i) = a -f 2) (®* cos kx + b k sin kx). 

A-l 


(97) 


If we regard T n (x) as an approximation to f(x), we may use the integral 
of the square of the error, or 



T n (x)\ 2 dx, 


(98) 


as a measure of the degree of the approximation, as in section 249. If 
we replace T n (x) by its expansion, multiply out, and recall the defini¬ 
tion Of the Fourier coefficients, as well as the values of the integrals 
of'the trigonometric functions and their squares and products given in 
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section 287, we find: 

E — f if( x )] 2 dx — IxaA — 2x £ (a*4i + M**) + 2xa 2 

**0 fc =1 

+ it X (®I + t>l) (99) 

= Cimr - 2 ta 2 - x £ (ai + b\) 

•/O i = l 

+ 2x(A - a) 2 + x £ {(A k - a*,) 2 + (B* - fr*) 2 ]. (100) 

^ = 1 

Since the squares are positive or zero, the second form shows that E is 
larger for any sum with one or more coefficients differing from the 
Fourier coefficients than for the sum formed with Fourier coefficients, 
that is T n — S n . This proves that: 

Of all trigonometric sums of a given order , the one formed with Fourier 
coefficients makes the integral of the square of the error least. 

For the sum with Fourier coefficients, we have: 

ixX ~ Sn(x ^ 2dx= ^X -^ 2rfx 

- A 2 - - £ {Al + Bl). (101) 

Z A = 1 

Since the left-hand side is greater than or equal to zero, the same is true 
of the right, and we have: 

" f t/(*)] 2 dx |> A 2 + l £ (Al + Bl). (102) 

Zn J 0 Z a, = i 

This is known as Bessel's inequality. The infinite series whose partial 
sums appear on the right of such relations converges, since it is a series 
of positive terms whose sum is bounded. 

We may show that it converges to the integral on the left as follows. 
By reasoning similar to that of section 291, if the integral of [/(x)] 2 exists 
as a proper or improper integral, we may find a step function S(x) such 
that: 

f T \f{x) - S(x)\ 2 dx<e. (103) 

J 0 

By changing the step function to a linear function in sufficiently small 
intervals including the points of discontinuity, we may find a continuous 
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periodic function c(x), such that: 



| S (*) ~ c (*)| 2 


dx < f. 


(104) 


By the result of section 295, the first Ces&ro sums for the Fourier series 
of c(x) approach this function uniformly. Hence we may find one of 
these sums, say C n (x) such that: 


|c(x) - C„(*)| g «, (105) 

and hence: 

|c(x) - C„(x)I 2 dx g e 2 2ir. (106) 



Finally, by a double application of the inequality (130) of section 
252, and the relations (103), (104), and (106), we find: 


f 2T \f(x) - C n (x)\ 2 dx g [.» + e 1 + (27r) } e ] 2 . 

V 0 


(107) 


Since c is arbitrary, this shows that there is a trigonometric sum, C n {x) } 
for which the integral on the left is arbitrarily small. But, if w r e form 
S n (x), the partial sum of the Fourier series for/(as) of the same order as 
C»(x), this will make the integral on the left less than or equal to its 
previous value, and the integral cannot be larger for any partial sum of a 
higher order. This proves that: 


lim f [f(x) 
”0 


- S n (x)) 2 dx = 0, 


(108) 


and, if the integral of [/(x)] 2 , and the integrals defining the Fourier coeffi¬ 
cients exist , the Fourier series for f(x) converges in the mean to f(x). The 
equality obtained by combining relations (108) and (101), or letting 
» —* oo in (102), is called Parseval's theorem. 

Since the series converges in the mean, by section 253, it may be inte¬ 
grated termwise and under the conditions just stated: The series obtained 
from the Fourier development of f(x) by termwise integration converges to 
the integral of the function. 

298. Modified Fourier Series. So far we have considered our funo 
timis as of period 2r, and the Fourier series as corresponding to the 
function for all values of x and converging to it for any value of x for 
which the sufficient conditions were met. We may, however, confine 
our attention to any interval of length 2ir, for example the interval 
0,2 jt or — T,ir. In this case the Fourier coefficients computed for the 
fundamental interval of Integration will lead to a series convergent, or 
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convergent in the mean, to the original function if the appropriate con¬ 
ditions are met for values of z in the fundamental interval. 

If we take as our fundamental interval ~7r,7r, and consider a function 
defined in this interval and odd , that is, one for which/(—x) —/(a;), 

the constant and cosine coefficients will all be zero, and we will have a 
series of sines only. Similarly, if we consider a function as defined in this 
interval and even , that is, one for which /(— x) ~ fix), the sine coeffi¬ 
cients will all be zero, and we shall have a constant term and a series of 
cosines only. Since the function may be arbitrarily given in the interval 
0 ,t and then defined in the interval — 7r,0 so as to be odd or even, we see 
that for the restricted interval 0,7r any function with f(x) and |/(x)| 
integrable will have a Fourier sine development and a Fourier cosine 
development. If in addition / (x) has an integrable square, each of these 
developments will converge in the mean to the function. 

If at x and — x one of the conditions of section 293 is met, the con¬ 
dition will be satisfied for each of the functions 


fix) +f(-x) 
2 


and 


fix) /( x) 
2 


(109) 


The first of these is even and the second odd, while fix) is equal to the 
sum of these two functions. Hence the constant and cosine terms for 
fix) will be the same as those for the first function, while the sine terms 
will be the same as those for the second function. Thus under the con¬ 
dition stated the sine terms will converge by themselves, and the con¬ 
stant and cosine terms will converge by themselves. 

By using the change of scale inverse to that introduced in section 288, 
we obtain developments in terms of sin i2irnx/T) and cos i2rnz/T) } 
for any function given in any interval of length T . Similarly, we may 
obtain developments in terms of sines alone, or of a constant and cosines 
alone, for a function given in any interval of length Tj 2. 

299, The Fourier Integral Theorem, If a function fix) is defined 
on the interval — P,P and the integrals for the coefficients exist, its 
Fourier partial sum may be written in the form 

+ (I10) 


analogous to equation (25). 

If we express the cosine in terms of exponentials, 


cos 


k(x — t)v 
P 


1 

2 


e F 


+ e 


-*(*-<)! 


> 

) 


( 111 ) 
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we may use the more symmetrical expression: 


jl r p r f 

2 P J.p L k “ n J 


fit) dt. 


If we now put: 


kw 

— = Uk, A Uk 


this may be written: 


~ £ a u k f e iu ^f(t) dt. 

Z7T k = —n — P 


If we put n = AP/ir and let P become infinite, since Aw* —► 0, this 
suggests an integral, namely, 


~ f du f e iu(x - n f(t) dt. 
2tt J -a 


In fact, if we let n and P increase in such a way that A — n/P remained 
constant, the expression (114) would approach this repeated integral as a 
limit. 

We know that, under certain conditions, the limit of the expression 
(110) as n —» oc with P fixed is f(x) in the interval — P to P. Since this 
makes n/P —> oo, we are led to take the limit of the expression (115) as 
A co. 

So far the procedure of this section has merely been heuristic, to help 
us guess the proper expression to use. We shall now prove that, with 
suitable restrictions, the limit of the expression (115) as A —► oo is/(x). 

Let us assume that f(x) is integrable in any finite interval, and that: 


f \f(*)\dx=* lira f |/(x)| dx 

«/-te M-*v. */-M 


exists. Then, since 
the integral 


0 »'u(x—() I _ 


f e iMx ~ n f(t ) dt 

v —oo 


converges uniformly in u. Hence we may integrate from —A to A and 
interchange the order of integration, and so find: 


I = f A du f e iu(x ~ l) fit) 

= f dt f e iuiz ~ t} f (t) du. 
«/_«, J-A 
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But 

so that 


X 


e 


iu(z—t) 


e iu(x-t) du = 

A l(X ~ t) 


2 sin A (x — t) 


x — t 


x; 


2 sin A (x — t) 
, x — t 


fit) dt. 


( 120 ) 

( 121 ) 


To discuss the behavior of this integral as A —> oo, we shall separate 
the interval of integration into the following ranges: 


5; x-$,x + $; x + (122) 

We choose B so large that: 


/ —B />* 

|/(*)| dx < (, I |/(x) 1 dx <e, B > x + 2, — B < x — 2. 

oo # 


(123) 


The first two conditions may be realized in view of the assumption that 
the integral of equation (116) converges. For t in the ranges — J5 
and By <*>, the last conditions make |x — t\ > 2. Since sin A (x — t) 
does not exceed unity, the integrand of I is dominated by |/(t)| in these 
ranges. Thus, by the first conditions (123), the contribution to / from 
these two intervals may be w T ritten: 

20% |0'[ < 1. (124) 

Next assume that, for values of the variable near x, the function 
satisfies one of the sufficient conditions given in section 293, or is such 
that the equation (56) holds for some positive 6. Thus 

lira f‘ f/(x + u) + f(x - u) - 2g(x)] du = 0. (125) 

7i—*>oo */ o 'U 

By using equations (35) and (53), and reasoning as in section 292, we 
may show that: 

g(x) = lim - f‘ —~~g(x) du. (126) 

n—►oo 7T *s o W 


Also, by putting u = ( — x for the term in f(x + u), and u = — t + x 
for the term in f(x — u), we find: 


r s !HLZ^ [/( 3 + M)+/( *_ M)]du 

«/o u 



sin n(x — t) 


m dt. 


(127) 


x — t 
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We may conclude from the last three equations that: 

/**+*2 sin n(x — t) n , . 

lim I --- f(Jt) dt =» 2 vg(x). (128) 

*—►<# J f X — t 

If we take the 8 which defines the middle interval ( 122 ) as a 8 for which 
equation (125), and hence (128) holds, we see that for A sufficiently 
large, say >A', the contribution to 1 from the middle interval may be 
written in the form: 

2 x 0 (x) + 0"t, \6"\ < 1 . (129) 

Finally, for the two intervals —B,x — 8 and x + h,B, we may use 
the Riemann theorem, and reason as in section 292 to show that the con¬ 
tribution to 1 from each of these intervals approaches zero as A becomes 
infinite. Thus, for A > A", it may be written 


On combining the contributions to I from the separate ranges as 
listed in the expressions (124), (129) and (130), we see that 

1 1 - 2x0(x)| < 5*, for A > A', A". (131) 

This shows that the limit of 1 as A becomes infinite is 2 x 0 (x), and: 

lim f du f e iuix ~ l) f (t) dt - g(x), (132) 

%* — A 1/-QO 


at any point where the condition (125) holds. Thus this limit is 
[f(x+) + /(x—)]/2 whenever any of the conditions of section 293 hold 
and in particular: 

If f(x) and |/(x)| are each integrable from — =» to *>, for any value of x 
where f(x) is continuous and one of the sufficient conditions of section 293 
holds, 


lim — f* du f 
JZo 2x J. A J _ 


e‘“<*- ( >/(<) dt = /(x). 


(133) 


This expression is known as a Fourier integral and this is one form of 
tha Fourier integral theorem. 

300. Other Fourier Integrals. If the conditions of the preceding 
section are satisfied, and we have convergence for all values of x, we 
may define a function: 

/a 00 

Ffu) - A f e~ iut m dt, 

—*o© 


(134) 
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where X is any positive constant. Then, from equation (133), 

f(x) — lim y. f e iux F{u) du, if V = • (135) 

A-+ oo J—A 2tt 

The function F{u) is known as the Fourier transform of f(x). The 
formulas become symmetrical if X = /ut = (1/V2 t), but it is often 
convenient to take X * 1, or ^ = 1. 

The equations (133), (134) and (135) hold if /(x) is a complex func¬ 
tion of a real variable, whose real and imaginary components satisfy 
the conditions previously imposed on the real function/(x). 

If the function/(x) is real, the Fourier integral may be written: 

lim - f du f cos u(x — t)f(t) dt — /(x), (136) 

A—► oo 7T «/ o ~oo 

since the imaginary part of the expression in equation (133) must be 
zero, and we may replace the integral from — A to A by twice that from 
0 to A since the first integral is an even function of u. 

If f(t) is real and even, we may take symmetrical intervals —M to M 
in calculating the first integral, and so have: 

2 r A r* 

lim -I du I cos ux cos uif(t) dt = /(x). (137) 

7T J o 0 

This leads to the formulas for the transform of an even function: 


F(u) = 2X f 

*^o 

f(x) = 2m/ cos u 
•'o 


cos utf(t) dt, 


cos ux F ( u) du, Xm = 


Similarly, if /(/) is real and odd, we find: 


2 pA /»« 

lim - I du I sin ux sin utf(t) dt = f(x), 

A-+*> * v o •'O 


and for the transforms: 


F(u) - —2 \i f sva utf(t) dt, 

Jo 

r® 1 

f{x) = 2pi J sin uxF(u) du, A*t ■» — • 
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301. Convolution. If 

*(*) = f fi{y)hix - y) dy, (143) 

—oo 

the function h(x) is called the convolution* of the two functions fi(x) and 
(x). It is defined for any value of x for which the integral on the right 
converges. 

If we reverse the roles of fi(x) and f 2 (x) and make the change of 
variable 

y — x — z, z — x — y> (144) 

we find: 

f 2 (y)fi(x - y)dy = f f 2 (x - z)/i(z) dz = h(x), (145) 

«/ —oO 



since we may replace the dummy variable of integration z by y. This 
shows that the convolution of a pair of functions does not depend on 
which of them we consider f\(x) and which f 2 (x). 

We may use equation (134) to define the Fourier transforms of each 
of the three functions fi(x),f 2 (x),h(x). They are: 

dt, F 2 (u) = X f e~ u %(t) dt, (146) 


Fi(u) 


«/ —00 


,—i ut 


7i(0 


H(U) 


='s: 


e~' ut h(t) dt. 


(147) 


If the functions/i(x),/ 2 (x) and h(x) are all integrable and absolutely 
integrable over the range — <x> to <», the integrals defining the transforms 
will all exist. Also, from the assumed convergence of the integral which 
defines the convolution, h( i), 

r N 

H(u) = lim lim XI dt 

M'—+OC M — *-<X> J-M' 
iVWx JV-*>ao 

The integrand of this repeated integral has its numerical value 

|e-‘“7i (y)h(t-y) | - l/i (v)h (t-y )|. (149) 


r N 

/ e-"“My)f 2 (t - y) dy. (148) 

«/ ~ 


But, on putting z — t — y,t~z + y, 


f dy f dt\fy(y)f 2 {t - y)\ = f dy\f x (y)\ f dz\f 2 (z )| 

*' -M d-M* J -U 'J-M -v 

si'Xi -ao 

Si / \fi(y)\dy f \h(z)\dz. (150) 

«/ —00 *'-00 


* Composition and the German “ Faltung ” are sometimes used. 
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Thus, by the remark made in section 244, the limit of the right member 
of equation (148) will be the same if we reverse the order of integration 
and let M ,N become infinite, before letting M f N become infinite. 
Also, on putting z = t —y, t = z -f y, 


so that: 


f e~ iut f 2 {t - y) (it = f e- iuz < 
//(«) = lim X f dyf l (y)e~ luv f 

M—*-oo _ \f t/_ 


e- iuz e~ iuv f 2 (z) dz, (151) 


e~ lu %(z) dz 


= X f h(y)c- iuv dy f f 2 (z)e~ iv 

^-00 V 


= " Fi(u)F 2 (u), 


in view of equation (146). 

We note that if h(x) is integrable over all finite ranges, h(x) must be 
intcgrable from — « to «>, from equation (150) and the relation: 

f \h(t)\dt g 

Thus we have proved that: If |/i(x)| and |/ 2 (x)j are integrable from 
— oo to oo, while f i (x), f 2 (x) and their convolution h(x) arc integrable 
over all finite ranges , then the product of the Fourier transforms of fi(x) 
and f 2 (x), formed with constant X, is X times the transform of their convolu¬ 
tion , 

F 1 {u)F 2 (u) « \H(u). (154) 


f dt f dy'fi(y)f,(t - 

*/_qo 


302. Functions of Integrable Square. It is desirable to have con¬ 
ditions on the functions f\ (x) and f 2 (x) which insure the proper behavior 
of their convolution. 

Let us assume first that the functions are c\(x) and c 2 (x), each con¬ 
tinuous for all values of x and zero for \x\ > Af. Then the convolution 
of these functions is given by 


h(x) = fi Ci(y)c 2 (x 


pM 

y) dy — I ci(y)c 2 (x - y) dy, 

J -M 


(155) 


since the integrand is zero outside of this range. Then the integrand is a 
continuous function of the two variables x and y } for all values, so that 
the proper integral is a continuous function of x. 

Next assume that each of our functions is integrable over all finite 
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ranges, and each has a square absolutely integrable over the infinite 
interval. Thus 


f \h(x)? 

«/—oo 


dx and 


/: 


\h(x)\ 2 dx 


(156) 


each exist. 

Then we may choose M so large that the integral of |/i (x) | 2 is less than 
«, for the part of the infinite range with jx| Si M. Also, on the range 
—M g x :£ M we may find a continuous function ci (x), zero for 
x — —M and x — M, such that 

|/i(x) - ci(x)| 2 dx < €, (157) 


fj 


by the construction used in section 297* If we define ci (x) as zero for 
\x\ > M, we have a function of the type first referred to. We proceed 
similarly to find a function continuous for all values of x, and zero 
for \x\ > M and such that 

\f 2 (x) - C2(x)\ 2 dx < t, (158) 


L 


Next take a series of values of «„ approaching zero. For each value 
we may find two functions ci. n (x) and c 2 , n (x). Then, as n becomes 
infinite, these give rise to two sequences of functions converging in the 
mean to fi(x) and f 2 (x). If h n (x) is the convolution of ci >n (x) and 
C 2 >b (x), it will be continuous for all values of x. But, from the con¬ 
vergence in the mean of Ci, n (y) to fi(y) and c 2 (x — y) to f 2 (x — y) for 
fixed x, it follows from section 251 that h n (x) approaches h(x), the con¬ 
volution of/i (x) and f 2 {x). Moreover, since the integral 



1/2 (* ~ V) - C2,n(x 


y)\ 2 dy < 


(159) 


the argument used in section 251 shows that the function h„(x) 
approaches h(x) uniformly in x, so that the limiting function g(x) is 
continuous. 

This proves that: If fi(x) and f 2 {x) are each integrable over all finite 
ranges, while |/i(x)| 2 and j/ 2 (s)| 2 are integrable from — » to «, then h(x), 
the convolution offi (x) andf 2 (x) is continuous for all values of x. 

If, in addition , |/i(x)| and |/ 2 (x)| are each integrable from —» to », 
the transforms of fi(x),f 2 (x) and h(x) exist, with 

Fi(u)F 2 (u) = \H(u). (160) 


The last remark follows from the results of the preceding section. 
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Note that, on the infinite range, we may have |/(x)| 2 integrable, with¬ 
out |/(x)| integrable. An example is: 

/(x) = 0, |*| <1, /(*)--, 1 <|*|. (161) 

X 

303. Generalized Transforms. The restriction that our functions 
should be absolutely integrable or have absolutely integrable squares 
may be satisfied in certain cases by using in place of given functions, 
other functions obtained from them by multiplication by a factor. For 
example, if f(x)e~ kxi has a transform, Fk(x), and when ft approaches 
zero Fk (x) approaches a limiting function, we might use this as a type of 
generalized transform of f(x). 

In one large class of applications, the functions are zero up to a certain 
point, and are either bounded, or at least dominated by a power of x for 
large positive values. 

In such cases we may use e~ kx as a convergence factor. To be more 
specific, let 

f(x) = 0, x < 0 and \f(x)\ < e ax for x > Xi, a > 0. (162) 

Let J(x) be integrable on all finite ranges. Then the function 

f(x)e~ kx , for ft > a, (163) 


is integrable, and together with its square absolutely integrable from 
— oo to oo. Consequently, it has a transform: 


Fk{u) = X J 

f* e~ iut f (t)e~ kt dt. 

— 00 

(164) 

- X J 

f W e~ iut f (l)e~ kt dt. 

0 

(165) 

We also note that, by equation (160), if F*,i(u) and F k) 2 (w) 
transforms of fi(x)e~ kx and/ 2 (x)e - * x , then 

are the 

Xff fc (u) = F k ,i(u)F k , 2 (u), 
where H k («) is the transform of the convolution: 

h k (x) = h{y)e~ kv f 2 (x - y)e~ k ^ dy 

(166) 

= f fi{y)h{x ~ y)e~ kx dy = e~ k *h(x), 
v 0 

(167) 

since the integrand is zero unless 0 £ y £ x. It follows that h k (x) 
and h(x) are 0 for x < 0. 



502 


FOURIER SERIES AND INTEGRALS 


[Chap. XIV 


Also, when the conditions of section 300 are satisfied, 


f(x)e~ kx = lim /x f c iux F k {u)du. 

A— J-i 


(168) 


We shall now prove that if z = k + ztq F* (w) is an analytic function 
of z } for k > a. We begin with the special transform C k (u), obtained 
from a function c(x) which is continuous for all values of x and is zero 
for x < 0, and x > M . Thus: 

J r*<x> pM 

e- iut c(t)e~ kt dt = / c{t)e~ zt dt. (169) 

0 ”0 


This is analytic for all z, by section 275, since the integrand is analytic in 
z and continuous in z and t . 

Next consider any function/(x) satisfying the conditions (162), and 
any number b > a. Then we may approximate f(x)e~ bx in the mean by 
a function c(x), of the type just used, by the construction used in section 
302. Furthermore, we may take a series of values of c» approaching 
zero, and for each € n determine a function c n (x ) of the special type such 
that: 



- c n (x)\ 2 dx < € n . 


Then the c n (t) converge in the mean to f(t)e bt . Also, 


(170) 


f 

”0 


-tut—rt 12 


dt 


-f 


-2 rt 


dt < 


2s 


if r > 5 > 0, 


so that e iut rt has a square absolutely integrable from 0 to 00 . 

e~ lut c n (t)e~ rt dt approaches I e~ lui f(t)e~ bt e~ rt dt, 

0 VQ 


Hence: 
(171) 


uniformly in r for r ^ s, by the reasoning of section 251. But each 
integral of the sequence has the form of that in equation (169), and 
so is an analytic function of r + iu. Hence, by section 273, the limiting 
integral is an analytic function of r + iu in the two-dimensional open 
region r > s. But, if k *= b + r, the limiting integral is that used to 
define F k (u) in equation (165). And an analytic function of r + iu is 
an analytic function of 6 + (r + iu) or z = k + iu. Moreover, for 
any number k > a } we may write: 


k — a 


b - a + s, r = 2 s, 


(172) 


so that Fu{y) is an analytic function of z = k + iu, for k > a, as we 
stated. 
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304. Laplace Transforms. When f(x) is integrable on any finite 
range and satisfies the conditions: 

f(x) = 0, x < 0 and \f(x)\ < e ax for x > x u a > 0, (173) 

we call the function defined by 

L(p) - e-t'mdt (174) 

**o 

the Laplace transform of the function /( x ). It is analytic for all complex 
values of p with Rp > a, or 

p = k + iu , with k > a, (175) 

as we proved at the end of the last section. 

We note that L(p) may be derived from (u) of equation (165) by 
putting X = 1, and replacing k + iu by p. For the convolution of the 
two functions/i ( x ) and/ 2 (x), each 0 for x < 0, we have 

h(x) = f fi(y)Mx - y) dy. (176) 


For the Laplace transform of h{x), we find: 

fV^(0c«- f c~ kt ~ iut h(t) dt = f e~ lu %(t)dt 

Jo j o J 0 


#*(«) = L 1 (p)L 2 (p), X = 1, 


(177) 


by equations (167) and (166). Thus, for functions of the type here 
considered, the Laplace transform of the convolution of two functions is the 
product of their Laplace transforms. 

We also note that if the function f(x) has a derivative, f'(x), which 
satisfies the conditions imposed on f(x), then the Laplace transform of 
f{x) is 



(178) 


Since it has a derivative for all x > 0, f(x) is continuous for such values 
and we may integrate by parts to obtain: 


pM 

Jo ‘ 


dt= e- p, m 


M 


J r M 
0 


+ / pe~ pt mdt. (179) 


By the condition (173), for values of p with k > a, the limit of the inte¬ 
grated part is zero for M —> °o. Thus we find: 


r e~ pt f(t) dt « /(0+) + p f e~ pt m dt. 

Ja Jo 


(180) 
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If the derivative is continuous for x = 0, since it is zero for x < 0, we 
must have/(0+) «* 0, and the Laplace transform of the derivative is 
the transform of the function multiplied by p. Otherwise the additional 
term appears. 

This relation of differentiation to multiplication by a variable in the 
transform is the basis for the use of Laplace transforms in solving 
differential equations. 

Before giving further details, we must find out in what sense the func¬ 
tion is determined by the transform. For functions having a finite 
derivative at all except a finite number of isolated points, the equation 
(135), or (168) applies, except at the isolated points. For other values 
of x we have equation (168) with y = 1/2 it since X = 1 and Xm = l/2ir. 
Hence: 

fix) = ~ f e lux+kx F k (u) du 

A—**a o 27T — A 

lim ~ f e pz L(p) du. (181) 

A—+X} 1/ 

Since p = k + in, dp — i du, and this may be written: 

1 pk+iA 

/(*) - lim — / e**L(p) dp. (182) 

A —♦•oo ATTt iA 

Thus, except at the isolated points, the function is determined by the 
value of the Laplace transform. 

In the applications we shall make, the function will be smooth except 
perhaps for x = 0, so that except at this single value, the function will be 
determined by its transform. 

305. Operational Solution of Differential Equations. Consider any 
linear differential equation with constant coefficients, which we write: 

» d h v 

So ai d? = b(x) - (183) 

Here the o* are constants and b is a function of x. Suppose the initial 
conditions are that y and its derivatives up to the (n — l)st order are 
zero for x ■» 0. (Suppose also that the problem has a solution which, 
together wi$£ its derivatives up to the nth order satisfies the conditions 
imposed <#£/(*) in the last section. Let b(x) also satisfy these con¬ 
ditions. v jflhen we may take the transforms of both sides of the equation. 
From the choice of our initial conditions, the integrated term in equation 
and the similar terms for the higher derivatives are all zero, and the 
tmisforxn rtf each derivative is obtained by multiplying the transform 
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of the function by a suitable power of p. Thus we find: 

£ a k p k Y = B, or P(p)Y = B, 

4-0 

where F is the Laplace transform of y and B is that of b(x). 
have: 


1 d _ y> 

P(p) tip-r 


(184) 
Then we 

(185) 


where we have used a partial fraction decomposition of the rational 
function 1 /P(p), and for simplicity only consider the case when all the 
roots are simple. For the multiple root case compare problems 50 and 
51 of Exercises XIV. 

Then, since 

J r » 00 1 

e rt e~ pt dt =-, R p > R r (186) 

o P ~ r 


we see that the fraction in the sum in equation (185) is the Laplace 
transform of A k e r k x y and by the theorem on convolutions, the product of 
the fraction by B is the Laplace transform of the convolution of A k e nx 
and b (x), or 


f b(y)A k e^ ) dy = A k e r ‘ x f b(y)e 

t/o */() 


The solution of the problem is the sum of terms of this form. 

The Laplace transform may also be applied to certain partial differen¬ 
tial equations with constant coefficients, reducing a problem originally 
containing partial derivatives with respect to two variables to a problem 
algebraic in one of the variables, and therefore capable of treatment as 
an ordinary differential equation in the other variable. 


EXERCISES XIV 

1 . Show that the definite integrals of sines, cosines and their products used 

J f*2r 

e imx € inx fa = 0 if m 7 ^ — n and 2tr if 
o 

—n, where m and n are integral,and that this isequivalentto Jz m + n ~ l dz — 0 

if m y* —n and 2 iri if m = — n, with C a circle with center at the origin. 

2. If a series of the form (5) of section 287 converges to f(x) either uniformly, 
or in the mean, then this series is the Fourier series for /(x). In the uniform 
case, f(x) is necessarily continuous, in the case of mean convergence we assume 
f(x) and |/(x)| 2 , implying |/(x)|, integrable over the fundamental interval. 
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3 . If f(x) and \f(x)\ are integrable over the fundamental interval, the Fourier 
coefficients exist and A n and B n each approach zero as n— > oo. Hint: Use 
Riemann’s theorem. 

4 . If for all values of x the periodic function }{x) has a Hh derivative, with 
f k (x) and f k (x) integrable over the fundamental interval, then n k A n and n k B n 
each approach zero as w —» . Hint: Integrate the integrals defining the 
coefficients by parts k times, noting that the integrated part vanishes by the 
periodicity, and apply problem 3 to f k (x). 

6. Show that if, for a particular x, equation (56) of section 292 holds for one 
positive 5, it holds for all positive d. 

6 . Show that 


r sin 6 

1 — 2r cos 8 + r 2 


QQ 


z 


n~ l 


r n sin nd 


and 


1 — r cos 6 
1—2 r cos 6 + r 2 


00 


= 1 + J r" cos nd, 

n~ 1 


M < i. 


Hint: Use section 287, with F(z) = 1/(1 — z), 

7 . Show that 

J QO y*Tl 

~ log (1 — 2r cos d + r 2 ) = — 22 — cos nd 
2 n = l n 


and 



r sin d 
— r cos 6 



sin nd, 


|r| < 1 and, for real r, d, the inverse tangent between — 7r /2 and 7r /2. Hint: Use 
section 287, with F(z) — log(l — z). 

8. Let f(x) have a Fourier series unifonnly convergent for all real x in conse¬ 
quence of one of the conditions of section 294. If we replace x in the series by 
a complex variable z, the uniform convergence cannot hold in any two dimen¬ 
sional region including an interval of one period on the real axis in its interior, 
unless the periodic function f(x) is analytic for all values of x. 

9. For any fixed real or complex r with \r\ < 1, and d complex, the expan¬ 
sions of problems 6 and 7 are valid and converge uniformly for d in some two 
dimensional strip of the complex plane including the real axis in its interior. A 
suitable branch of the inverse tangent must be used. 

10. Show that 



co yin —1 

n?i 2n - 


1 


sin (2 n — 1)0, 


]r| < 1, an«$^ for real r,d, the tan” 1 between — tt/ 2 and v/2. Hint: Use sec¬ 
tion 287, itfrfth F(z) * log (1 - z) — log (1 + z)- 
11. The sine series of period 2 p which represents ax + b in the interval 


6 < p is - 22 P n Bin —^ with P n 

* »-i V 


46 + 2 ap 


for n odd, and P n ~ 


2 ap 
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for n even. Hint: First verify the special cases, for 0 < x < it, 


4 / . 1 
= r\ SmX + 3 

= 2^sin x — ~ s 


sin Zx + ~ sin 5x + 
5 


J . 1 1 . \ 

x = 21 sin x — ~ sin 2x *4" ~ sm 3x -f- • » • J • 

12 . The cosine series of period 2 p which represents ax + 6 in the interval 

(2 n — 1)tx 
cog - 

„ ^ ^ , . a V 4rzp ^ p 

Q ^ x ^ pisb + y - ~y £ -77-7TT-" # 

2 7T 2 n = i (2 n - 1 )- 

13 . If/( 2 ) is single-valued and analytic in the ring ri < \z\ < r 2 , and n. < r < r 2 
the Fourier series for f(re'°), regarded as a periodic function of 6, may be obtained 
from the Laurent series for/(z) described in problem 27 of Exercises XIII. 

14 . If F(w) is of period 2 p and analytic for all w — u + iv with |r| < h t 
w'here h > 0, the Fourier series for F(a) may be obtained by taking 


and r = 1 in problem 13. 




16 . Illustrate problem 14 for F(w) — 


1 - 6 2 


1 — 2b cos w + b 

Here p = w, n = |6|, r 2 = 1/|6|. Hence 


i , \h\ < 1 . 


(6 2 - l)g _ 

bz 2 - (1 + h 2 )z + b 


- = i + r f> n (z n + 2 _n ). 

l n=i 


by problem 28 of Exercises XIII, and the series for F(a) is 1 + 22 26” cos nu. 

n —1 

This checks with problems 6 and 9. Whenever, as in problems 6, 7, and 10, 
the expansion can be found from a Taylor’s series this is simpler than the pro¬ 
cedure of problem 14. 

16 . Let/(*) be of period 2/;, and/(x) and \f(x)\ integrable over some interval 
of length 2 p. Prove that formal termwise integration of the Fourier series for 
f(x) yields a series which converges to the integral of /(.r) on any finite interval. 

Hint: By a change of scale we may take p — 7r. The variation of f f(t) dt 


on any interval a,6 is at most 


J |/(01 dt. Also, the first integral increases by 

a 


2rA when x is increased by 27r. Hence g(x) 


f(t) dt — Ax is periodic, 


continuous and of bounded variation so that its Fourier series converges to it 
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for all values, in particular x and a. Subtracting these two series gives 

f(t) dt — A(x — a) «■ - 2 / ( cos — $) — cos n(f — a)] g(t) dt. 

W n»i */o 

But, since the Fourier series for f(t) and h(t) = /(f) — A only differ in the 

i r 2v 

constant terms, we have A n cos nx + B n sin nx =* - I cos n(f — x)/i(f) di. 

Xt/Q 

Integrate from a to x, and invert the order of integration to obtain 

i r 2 * 

-I [sin n(t — x) — sin n(£ — a)]A(0 df. 

nx J o 

An integration by parts (problem 27 of Exercises VIII) gives: 


--[sin n(t — x) — sin n(t — a)] p(0 

mr 


i r 2r 

+ ~ I [cos n(t — x) — cos n(f — a)] #(<) dt. 

TTj 0 


The integrated part is zero by the periodicity, and the other part is one term of 
the series shown to equal the integral of f(x) minus the integral of the constant 
term. 

17. Show that, for 0 < x < x, 

7 r sin 3x sin 5x sin 7x 

i = 8 mx + — + — + — + •”. 

xx 7r 2 cos 3x cos 5x 

- - + - = C°8X + — + — + • • ‘ , 

xx 2 x 2 x . sin 3x sin 5x 

“T + T = smx + 'F _ + "^ _ + ---- 

Hint: Use problem 11 for the first series, and integration, valid by section 297 
or problem 10, for the others. The constants are determined by equating the 
integral of the left member from 0 to x to zero, for the cosine series; and using 
the validity of the series at zero for the sine series. 

18. Show that, for 0 < x < x, 


X X 

2 + 4 


XX x z 

7 + 24 


sin 2x sin 4x sin fix 


12 “ 8 + 24 


2 

+ 

4 

+ 

6 + 

cos 2x 


cos 4x 


cos fix 

2 2 

+ 

4 s 

+ 

6 s + 

sin 2z 

+ 

sin 4x 

i« 

+ 

sin 6x 

+ 


See hint to problem 17. 
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19 * Let f(x) be periodic and continuous, and such that f(x) — J 4>(z) dx, 

where \4>(x)\ is integrable over any finite range. Then the Fourier series for 
<p(x) may be obtained from that for f(x) by termwise differentiation. At any 
x where <j>(x) satisfies one of the conditions of section 293, the series will con¬ 
verge to it. Hint: Use problem 16. Problems 17 and 18 furnish examples. 

20. The series obtained by differentiating the first series of problem 17, or of 
problem 18, termwise, does not converge for any real value of x. Hint: Show 
that the terms do not approach zero, reasoning as for problem 23 of Exercises III. 
In each case, for x not a multiple of ir, f'(z) exists and is constant. However, 
in an interval including a discontinuity of the periodic function f(z), f(x) is not 
the integral of J'{x), and the argument of problem 19 does not apply. 

O0 

21. If — ir < x < 7r, and e®* = A + £ [A n cos nx + B n sin nx], by the 

n=*l 

method used for problem 17, 


e A . , « i„ sin nx — B n cos nx 

-= Ax + £- 

a a n*i n 


Replacing Ax by 2A(sinz — sin 2x /2 -f sin 3x /3 — • • •), found from prob¬ 
lem 11, and comparing coefficients with the first relation determines A n and B n 
in terms of A. A may be directly calculated, so that, for — x < x < ir: 


22. Show that 


and 


sinh ax 


cosh ax 


2 sinh aw f 1 , JS, . „. a cos nx — n sin nx 1 

=-hr + £ (~i) n -r—i- 

7r L2a n=i a 4 * + n J 

ah air f sin x 2 sin 2x 3 sin 3 z 1 

tt LI 2 + a 2 ~~ 2 2 + a 2 + 3 2 + a 2 J 

inha7r fjL 
ir [_2a 2 


2 sinh < 


2a sinh < 


cos x 


cos 2x cos 3x 


l 2 -fa 2 2 2 + a 2 3 2 + a 2 


for — x < x < ir. Hint: Use the result of problem 21. 
23. Show that 


sm ax 


and 


2 sin air T sin a; 2 sin 2x 3 sin 3x ^ 

x Ll 2 - « 2 ~ 2 2 ~ a 2 + 3 2 - a 2 _ 


cos ax 


2a sin air 1 
ir J2a z 


cos x cos 2x cos Sx 
l 2 - a 2 “ 2* - a* + 3 s - a* 


for — ir < x < x. Hint: For x real and fixed, and a complex in a closed region 
of the plane excluding poles of the terms, the series of problem 22 converge uni¬ 
formly and so are analytic functions of a. Hence they are valid for a = bi, b real. 

24 . Deduce the partial fraction expansions for esc z and cot z of section 284 
from problem 23. Hint: Put i»0, and x » x in the second expansion, and 
a ■» zj x. 
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25. As an example where f(x) is integrable, but unbounded, we have: 


X 

log sin - 


-log 2 - 


cos x cos 2x cos Sx 


, x . n . cos x cos 2x , cos 3a: 

log cos- = —log 2 H - -5- +-3 -. 

for any x which makes the left member finite. Hint: By equations (27), (30) 


and (49) we find 


s ,*r 

it J 0 


'-f 


sin nu cot - du = 1 . From this, by integrating by 
2 


log sin - cos nudu 
2 


: • This shows that 


log sin- = A — X) 


Replacing x by t 


a:, log cos- = A + £ ( —l) n+1 - 
2 n =l 


To determine 


A , put 2 x in place of a: in the first series, and deduce from log [sin x\ = 
log 2 + log |sin x/2| + log |cos a*/2| that A = log 2 + 2/1, or .4 = —log 2 . 

26. Deduce from problem 25 that, when log |tan x /2| is finite, log |tan a: /2| = 
—2 (cosx/1 + cos 3a:/3 + cos 5a:/5 + • • •)• Hence, by the method of prob¬ 
lem 17, show that for all x , 

j ^ x . 3 i/| , _ Tsin x , sin 3a* , sin 5a: ! 

. 108 *»■> <<“ - ~ 2 |_“jr + —p~ + “gi - + " J 

and 

r dv f log tan - du — - / dw f dv f log tan U du = 

Jo 2 ?r Jo Jo Jo 2 


log tan - dw- 

2 7T 


log tan - dw 
2 


cos x ( cos 3a: ( cos 5x t 


27. Show that, if /(x) and |/(x)| are integrable over the fundamental interval, 
the Fourier series is summable (Cl) to lf(x+) + f(x—)]/2 at any point where 
these limits both exist. Hint: Use the reasoning of section 295, with the factor 
lf(x + u) +f(x — u) — 2f(x)] replaced by the sum of [f(x + u) — f(x+)] and 
lf( x + U )-f (*-)). 

28. ^problem 11, the sine series equal to 1 for 0 < x < tt is: 4 /jt (sin x/l + 
sin 3xJS + sin 5x /5 + •••)• Its sum is —1 for — w < x < 0, and 0 at 0, 
—S' and 7r. Let m — 2n — 1, and S m (x) be the sum to m terms. Show that, 

zero, the approximating curves S m (x) tend to approximate the three line 
1, x < 0, y = 1, x > 0 and —K g y g K, x = 0, where 

it, approximately 1.17. (Gronwall.) As this exceeds 1, the 


^segments y - - 

• - f r —, 

■xjo t 
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third segment extends beyond the other two. Hint: For the derivative, 
7r /4 $m(aO == cos x + cos 3x + • • ■ + cos (2n — l)x = sin 2 nx /(2 sin x). Hence, 
for 0 < x < 7r /2, S m (x) has a maximum for 2 nx = 7 r, or an odd multiple of 

sin 2 nx 


ir. Moreover S m (x) 


= - 2 r 

7T Jo 


sin x 


- dx. Since sin x increases, by reasoning 


as m. 


similar to that for equation (67) in section 293, the biggest maximum is at 
x ~ 7t /2n. Now interpret the sum for S m ( it /2n) as a Riemann sum approximat¬ 
ing the integral - / -— dt, with A x — ir In, and thus show that the limit 

TrJot 

or 7 i—> qo is the integral. The numerical value may be found by Simpson’s 
rule, section 145, or by expanding sin t in a power series. 

29 . Gibbs' phenomenon: Let /(x) be of bounded variation in some interval 
Jo — h, xo + h, where x 0 is a point of discontinuity, so that f(x o—) 9 ^ }{x Q-f~), 
but for xo — h < x < x 0 or x 0 < x < Xo + h let f(x) be continuous. Assume 
also that f(x) and |/(.r)| are integrable over the fundamental interval. Then 
the approximating curves of the Fourier partial sums, S n (x), near xo, tend to 
approximate a graph made up of two continuous pieces representing f(x) in the 
open intervals x 0 — h < x < x 0 and xq < x < x 0 + h, together with the seg¬ 
ment obtained by extending that joining xo,/(xo —) and XqJ(x o+) equally in 

2 sin t 

each direction to a length K times the original length. K = - I- dt , 


approximately 1.17. That the approximations tend to this increased segment is 
known as Gibbs’ phenomenon. Hint: If <t>(x) is the function of problem 28, 
the function /(x) — 4>(x— x 0 ) [/(x 0 + ) — f(x o — )] /2 is continuous at .r 0 , and for 
hi < h and xo — hi < x < x 0 + its Fourier series converges uniformly. 

30 . The behavior of the Fejer sums of the function of problem 28, for fixed x, 
is given by problem 27. Show that the Fejer sums for this function, C n (x), near 
zero tend to approximate the three line segments y — — 1, x < 0; y = 1, x > 0 
and — 1 S y ^ 1 , x — 0 . Hint: As C n (x) is a weighted average of values of the 
function with a positive weighting factor, its values must lie between ~1 and 1. 
The result then follows from problem 27, for fixed x near x 0 , and the fact that 
C n (x) is continuous for all x. 

31 . The Fejer sums for the function/(x) of problem 29 do not exhibit Gibbs’ 
phenomenon, that is, the vertical segment is that joining xo,f(xo—) and Xo, 
f(x o). Hint: Reason as in problem 29, using the property of 4>(x) proved in 
problem 30. 

32 . Deduce the result of problem 45, Exercises XIII from problems 7 and 25. 
Hint: The constant term of problem 7 gives the integral forlpl < 1, those of 
problem 25 for p = 1 or — 1; for |p| > 1, put p = 1 /q as in problem 45, Exercises 

XHL 

33. If/(x) and |/(x)| are integrable from 0 to 2?r, A , A n , and B n are its Fourier 
coefficients, and |r| < ], 


A + 


00 

r 


(A n cos n6 + B n sin nB)r n 


r 2v _ 1 - r 2 _ 

2ir Jq 1 — 2r cos (d — /) + r 2 ^ 
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Hint: The series of problem 15 converges uniformly for u real and any |5| < 1. 
Put 6 « r, u * Q — f, multiply by f(t), and integrate termwise. 

34. If f(x) is of period 2ir } and continuous for all values, and r is real and less 
than 1, 


lim 

r—►! — 


i. r 1 ~ fg 

2irJo 1 — 2r cos (fi — t) + r 2 


m dt - m. 


Hint: Reason as in section 295, noting that the fraction multiplying f(t) is 
positive, and its integral from 0 to 2t is by putting/(0 = 1 and A = 1, A n 
** B n ~ 0, in problem 33. And \f(t) —f(0)\ < e when cos (0— t) > I — 5. 

35. Prove that for any particular 0 for which the Fourier series for/(0) con- 
verges to g(B) } the limit in problem 34 is g(d). Hint: Use problem 33, and Abel's 
theorem of problem 15, Exercises XIII. An example is found by comparing 
problems 25 and 7. 

36. If f(x) and |/(x)| are integrable from 0 to 27r, the limit in problem 34 is 
[/(x+) + /(x—)] /2, at any point where both limits exist. Hint: Reason as in 
problems 34 and 27. 

37. The integral of problems 33, 34, 35 and 36 is called Poisson’s integral. It 
enables us to find a function which satisfies Laplace’s equation, problem 1 of 
Exercises XIII, inside the unit circle, and takes given values/(0) on the boundary 
whenever the relation of problem 34 holds. Hint: With z = x + iy = re td , 
{A n cos n0 + Bn sin n0)r n is R(A n z n — iBnZ n ), so that by problem 33 the integral 
is the real part of an analytic function inside the circle. 

38. If S n = u\ + U 2 + • * * + u n is the partial sum to n terms of an infinite 
series which is summable (Cl), and t n = u i + 2 u n + • • • + nu n , a necessary and 
sufficient condition for the ordinary convergence of the series is that t n !n—> 0. 
Hint: t n « (n + l)S n — nC n ; t n ln—> lim ( S n — C n ) = L — L if £w n is con¬ 
vergent. And S n lim C n if t n In 0. 

39. A necessary and sufficient condition for any series ]£w n to be summable 

t n 

(Cl) is that £ “7—TT\ > where t n = u\ + 2ui + • • • + rm n , be convergent. 
n\n -t* 1) 

Hint: t n - (n + 1)$» — nC n ; S n = nC n — (n — l)C n -i so that 


tn n „ n - 1 „ % ^ t k n „ 

~~7~ =* —~ Cn —-C n -1 and 2- ——r * —— C n - 

n(n +1) n + 1 n k(k + 1) n + 1 

40. If 2*w n is summable (Cl), and u n ~ 0(1 /n), then £u n is convergent. 
(Hardy.) Hint: If J^u n is not convergent, by problem 38, t n /n is either > a, or 
< —a for an infinite number of values of n, say n = m, for some a > 0. In the 
second case, replace u n by — u n . Again £ n4 .i « + (n + 1 )u n > t n — K, for 

some positive K , and n > n', by the definition of u n = 0(1/n) in section 81. 
H^e, for any w > n', Wf* > amJ2 MO ^ k^ k\ where amj2K — 1 < V S 
mt2K. 

"it*' <„ am/2[(am/2tf) - H , ,. 

^T+l) > + th. .ppr^ahe. . portv. 
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limit for tn-* *> by the Cauchy criterion the series 22 ~ 7 ~~ T ~ T T cannot con- 

n(n + 1) 

verge. By problem 39 this contradicts the assumption that 2 Z u n is summabie 

(Cl). 

41 . If f(x) and \f(x)\ are integrable from 0 to 2 t, and A n = 0(l/n), 
B n = 0(1 /n) t the Fourier series converges to [/(#+) + f(x—)]/2 at any point 
where both limits exist. Hint: Use problems 27 and 40. Some of the conditions 
of section 293 may be proved from this point of view if they hold over the entire 
interval. 

42 . An example of a continuous periodic function whose Fourier series fails to 

00 1 2 
converge for x = 0 is/(a;) =* 22 1 T(P n ,Q n ,x), where P n = 

n« 1 n £ 

Qn ~ 2 (jPi + P 2 + ’ ■ * + Pn- 1 ), 


and for integral P,Q, 


cos (Q + 2 )x 

« r»r> o • * . * I 


COS (Q + P)x 


2P - 1 1 2 P - 3 

cos (Q + P + l)z cos (Q + P -f 2)x cos (Q + 2P) x 

- - 3 2 P - 1 


(Fejer) 


Hint: By grouping the terms with the same denominators, 

x 

/ P sin (2k - 1) - 

T(P,Q,x) = 2 sin [Q + P + -J * £ .—- 

Hence, by problem 28, T(P,Q,x) is bounded. Thus the series defining f(x) con¬ 
verges uniformly, and f(x) is continuous for all x. Also, the Fourier coefficients 
of f(x) may be obtained from this by termwise integration, and the choice of P n 
and Q n is such that a term cos mx appears in only one T(P n) Q nj x) and its coeffi¬ 
cient, divided by n 2 will be A n . A and all the B n will be zero. Thus, when the T 
are decomposed, the series is the Fourier series for f(x ). But, at 0, the particular 
sum to Q n + P w terms is 1 /n 2 [ 1 /( 2 P„ — 1 ) + 1 /(2P n — 3) + * * • + 1 /3 + 1] > 
(log n) /2, since 2[1 + 1/3 + 1/5 + • • • + 1/(2? - 1)] > 1 + 1/2 + 1/3 + • * • 
C P dt 

+ 1 IP > J ~j ^ log P, and log P n = n 2 log n. Thus the Fourier series 

diverges at 0, since for one sequence of integers, m = ( Q n + Pn) —^► 00 as n «, 
the sums Note that for w! = Q n , lim S m > = /( 0) = 0, so that remov¬ 

ing parentheses renders a convergent series divergent, as remarked in section 187. 

43. Using the definitions of P n , Qn and T(P,Q t x) given in problem 42, show 
00 1 

that F(x) ** 22 ~9 T(P n >Q n >n ! 2 irx) is periodic with period 1, continuous for all 
nmi n z 

x, and has a Fourier series divergent for all rational values of x. 
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44. Verify that if /(x) = c, a< x <b and f(x) = 0, x < a or x > b f the 
Fourier transform F(w) = c(e~ iua — e~ xub ) jiu . Also that 


lim f e iuT F(u) du — 

A—►« —A 


c C 00 sin «(x — a) 
2ttJq l « 


sin w(x — 6 )”| 
- du 

u J 


c 

2 


if x = a or b and otherwise equals f(x). If we replace b by <*>, the term in 6 in 
F(u) is replaced by zero. Hint: Use problem 31 of Exercises XII. 

45. If /i(x) and / 2 (x) are functions of the type defined in problem 44, using 
constants a, b } c and a , b c', with a < a < b' < b, calculate the convolution 
k(x), and verify that its graph is polygonal, with vertices at x = a + a', 
a + ba -f b, and 6 + b'. 

46. If F(u) is the transform of/(x), and a > 0, then (1 /a)F(u/a) is the trans¬ 
form of /(ox). 

47. The transform of f(x) = e~ ** is F(w) = X\/7re“ u2/4 , and the transform of 
/(x) = is F(u) — \\^2Tre~ u2i2 . Hint: Use problem 46 of Exercises XIII. 

48. For some pair of numbers a,b let /(x) be the difference of two monotonic 
functions for x ^ a, and for x ^ 6, where each monotonic function is integrable 
on the semi-infinite range — <x> , a or b,^ on which it is defined. Let /(x) be of 
bounded variation for a g x S b. Define g(x) — [/(x-f) + /(x — )]/2, so that 
f(x) — g(x) at all points of continuity and has the same transform F(u) = G(u). 
Then: 

i 9(2rk) = n i F(n) 

& = — qo n — — co 

* / 2 tt«\ * 

and £ FI-I = a\ £ a > 0. 

n a= — X \ n / k = —<x> 


These formulas, and in particular the special case given in problem 49, are known 
as the Poisson formula. Hint: A rnonotonic function integrable on 6 , ao is either 
positive and decreasing to zero or negative and increasing to zero. Reversing 
the sign of the function converts the second case to the first, while reversing the 
sign of x reduces the range — <», a to —a,°o. Hence, by section 192, the series 

CO 

2 g(x + 2? rk) = 0 (x) converges, for all x. From its form, the series is of 

period 2 tt. For x on any finite range, the convergence is uniform, and 0 (x) is of 
bounded variation, since an infinite series of monotonic terms is monotonic, and 
a finite sum of functions of bounded variation is of bounded variation. Also 
[ 0 (x+) + 0 (x~)]/2 ~ 0 (x), since g(x) has this property. Hence, by section 
293 the Fourier series for <f>(x) converges to it for all x. In particular, for x = 0, 


£ g(2irk) * 0 ( 0 ) * lim ~~ f (l + £ 2 cos nM 0 

k*'*OQ N-+*> ** \ n»l / 

X oo 00 /*» 

g(t)e~ int dt » 2 / 

<30 & = —00 «/-7T 


2 cos nt ) 0(0 dL Again, for 


g(t + 2 Tk)e~ int dt 


<j>(t)e~ int dt. Here the interval — 00,00 is decomposed into intervals 



EXERCISES XIV 


515 


2ir(k — 1 ), 27 r(k + 1 ), the variable changed by t\ = t + 2irk, and use made of 
e -%n{*vk) _ ^ f or integral. The integration of 4>{t)e~ %nt by termwise inte¬ 
gration of the series is justified by the uniform convergence. Finally 

N N C T . i n* ( n \ 

X F(n) — X / <p(t)e~ l7lt dl — — I 0(£) ( 1 + X 2 cos nM eft. 

n-—N n« — JV v— t ^7T \ n = l / 

Letting N —> oo and noting that the limit is that shown to be 0(0) gives the first 
relation. The second relation follows from the first by problem 46. 

49 . For x real and positive, and the square root positive: 

00 1 00 oTT 

L =J r T. « 5 

n =* — oo v ^ n=-co 


or 


9 + Z e - 2 

^ n~l 


i n 
\A (a 


00 


+ x 



HiVft: Use the Poisson formula of problem 48, and problem 47. Whenever the 
functions are even, the double sums can be replaced by single sums as is done in 
the second form. 

x k 1 

60. The Laplace transform of — e rx is 7 - 7777 , for Rp > Rr. Hint: Dif- 

k ! (p — r) k+l 

ferentiate equation (186) of section 305 with respect to r k times. 

61. Verify the relation of equation (182) for the Laplace transform of problem 
50. Hint: Close the contour by a large semicircle of radius A to the left of the 
line joining £ — iA and k + L4, and calculate the residue at r. This is often the 
simplest method of finding the function which has a given L(p) as its transform, 
even when L(p) is rational. For the semicircle argue as in .section 281. 

62. Prove that the Laplace transform of Jo{bx), where the Bessel’s function is 
defined in problem) 10 of Exercises XIII, is given by 


j r»oo 1 

Jo(ht) dt = -7 -> for R p> b> 0. 

0 V p~ b 2 

Hint: Use problem 18 of Exercises XIII for p real. 
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DIFFERENTIAL EQUATIONS 

In this chapter we prove certain existence theorems for ordinary 
differential equations, as well as one for a special type of partial differen¬ 
tial equation. 

We also discuss certain theorems on envelopes, which are related to 
these existence theorems. 

306. The First Order Analytic Equation. We begin by proving that: 

There is a unique function y(x), analytic for all values of the complex 
variable x sufficiently near x 0 , \x — x 0 | < h, and such that y(x 0 ) = yo, 
which satisfies the first-order differential equation 

^ = f(x,y), (1) 


provided that the function f (x,y) is an analytic function of the two complex 
variables x,y at Xo,y 0 . 

Since f(x,y) is analytic, by section 286, it has an expansion: 

f(x,y) = £ Z a j,k~] (® - x 0 ) j (y - y 0 ) k ~ i , (2) 

*-0j«0 


convergent for all x and y such that \x — x 0 | < H, \y — y 0 \ < K. To 
simplify the writing, we select H', 0 < H' < min ( H,K ), and make the 
change of variable: 




(3) 


This reduces the theorem to the case for"which the initial values are 
0,0 and the power series converges for all values numerically at most 
unity. Using the original notation for this case, we have to solve: 

£=/(*,!/); 2/(0) - o, (4) 

where , 


UpO - <*oo + Oxo® + Ooiy + Olio® 2 + <*nxy + oq 2 V 2 H-. (6) 

If_ ti# problem has an analytic solution, we must have: 

^ *'* y ■# Cjx + C2X 2 -f- C3X 3 + • • •, 

I' sia 


(6) 



Abt. 306] THE FIRST ORDER ANALYTIC EQUATION 


517 


where the series has no constant term, since 2 /( 0 ) = 0. Inside any circle 
of uniform convergence for this series, we may differentiate termwise, so 
that: 

dy 

— = Ci + 2 c 2 x + 3 c 3 x 2 + 4c 4 x 3 + • * • . (7) 

Again, for sufficiently small values of x, by the results of sections 274 
and 286, the function of x defined by equations (5) and ( 6 ) will be 
analytic and have an expansion: 

f(x y y) = a 0 o + a l0 x + a 01 (c x x + c 2 x 2 + c 3 x 3 + •••)+ a 20 x 2 
+ a n {cix z + c 2 x 3 + ••*) + a 02 (c?x 2 + 2cxc 2 a: 3 + • • •) 

4” ^30X 3 + &2i(Ci£ 3 H" * * *) “f" dl2( G \X 3 + * * *) 

+ 003 (CiX 3 + *••) + *'*• (8) 

By equating coefficients in the expansions (7) and ( 8 ), in accordance 
with equation (4), we find: 

Ci = doo, 

2c 2 = Uio + ctoi^i, 

3c 3 = a 0 ic 2 + a 2 o + 0 nCi + ao 2 Ci, 

4c 4 = aoi c 3 + unC 2 + 2aQ 2 c\C 2 + a 3 o + u 2 iCi + ai 2 c? + ao 3 Ci. (9) 

These equations enable us to determine the coefficients, since at each 
stage the subscripts of the C{ on the right are less than that of the c* 
in the left member. The c* so determined will lead to an expansion ( 6 ) 
for a function which satisfies all the conditions in any region where it 
converges. 

To show that the expansion so obtained does have a positive radius of 
convergence, we proceed as follows. From the choice of H f , the series 
( 5 ) converges absolutely for x = 1 >y = 1 . Hence the series 

10oo| + l a i°l + Ifloil + l a 2 ol + lant + I 0 O 2 I + • * • (10) 

converges. Thus the terms approach zero, and there is some point 
beyond which all are less than unity. Let M be a number greater 
than all the terms preceding this point, and also greater than unity. 
Then in the sense of numerical values of the terms, the series 

M(1 + x + y + x 2 + xy + y 2 + • ■ •) (11) 

dominates the series (5), since | 0 *y^V| < \Mx % y’\. But this series is: 

M 

M(i+ x + x 2 + -- 0(1 + v + y 2 + • • •) - (1 _ x)(1 _ y y (12) 
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Now consider the differential equation 
dy M 


dx (1 - aj)(l - y) 

which, by the procedure of section 134, may be written: 

M dx 


(1 — y) dy = 


(1-x) 


This will be satisfied if: 


(13) 


(14) 


y - = -M log (1 - x) + K. 


(15) 


To make 3 /( 0 ) = 0, we must take K = 0, and use the root of the quad¬ 
ratic equation _ 

y = 1 - Vl + 2 M log (1 - x), (16) 

which makes the radical 1 when x = 0. Since the branch of the func¬ 
tion (10) determined by these conditions is analytic for x = 0, it has a 
power series expansion 

y = C\X + C^x 2 + C 3 X 3 + • • • , (17) 

and |y| < 1 for sufficiently small values of x, say 

|*| < h'. (18) 

Since the expansion (17) comes from an analytic function which solves 
the differential equation (13) with y(0) — 0, its coefficients will solve the 
equations obtained from (9) by replacing all the a u - by M, and the c, by 
Ci. Since all the algebraic signs in equations (9) are positive, we see 
that all the C,- will be positive. Moreover, since M exceeds all the 
|oi/|, the first and hence all following C,- will exceed the |c,|. Thus the 
series (6), with coefficients found from the equations (9) will be domi¬ 
nated by the series (17), and hence converge for |x| < h'. 

This proves the existence of a solution, as stated. Since the coeffi¬ 
cients were uniquely determined, there is no other analytic solution 
satisfying the initial conditions. By section 282 the expansion or any 
function obtained from it by analytic continuation will be a solution of 
the differential equation, provided that f(x,y) remains analytic along 
the path of continuation. 

907. Systems of Equations. A single differential equation of higher 
order than the first, say the nth, 

d y (n) - fix,v,v',v”, • ■ • 1 


(19) 
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is equivalent to a system of equations of the first order, obtained by 
writing: 

y = «i. y' = « 2 , y" = w 3 , • • •, j/ (n_1) = u n . (20) 


The system then is: 


and 


du i 
dx 


— Uz 


du 2 
’lx 
du n 
dx 


dWn_l 

1 j — 

dx 


= /(x, Mj, W 2 , U 3 , • • • , «n) • 


( 21 ) 


A similar device may be used to reduce a system of p differential equa¬ 
tions, of various orders, involving p independent variables to a system 
of equations of the first order, if certain algebraic conditions enabling 
us to solve for the highest derivatives of each variable are satisfied. 

As initial conditions for the higher order case, we may prescribe the 
value of each variable, and its derivatives up to an order one less than 
the highest order which appears. For the system of the first order this 
corresponds to prescribing the initial value of each variable. A theorem 
similar to that of the preceding section may be proved for any system: 

TT = Fk(x, y u 2 / 2 ) ' * * »2 In), k = 1, 2, 3, • • •, n. (22) 


If each of the n functions F* (x,t/,•) is an analytic function of the n + 1 
variables, there is a uniquely defined set of functions of x , analytic for 
|x — Xo| < A, and such that y»(0) = y^. This theorem is proved by 
reasoning similar to that just given. We first make a change of vari¬ 
ables of the form (3), here 


v z - x 0 


Y,- 


Vi ~ 2/»,o 
~H r ~ > 


(23) 


which reduces the problem to one in which the initial values are all zero, 
and the expansions for the functions Fk(x,yi) all converge absolutely for 
the values x = = 1. 

We then find formal series expansions which will represent the solu¬ 
tion if they converge. These series are dominated by the series for the 
solution of the system: 

dyk = _ M _ 

dx (1 - x) ft (1 - yd 


(24) 


But this system may be solved, for the given initial values, by putting 
Vi = y, where y( 0) = 0, 
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dy _ M 

dx (1 - x)(l - y) n 


A solution of this problem is found from 

1 - (1 - y) n+1 = - (n + 1 )M log (1 - x), 

to be 

1 

y = 1 - [1 + (n + 1 )M log (1 - x)] (n+1) . 


(25) 

(26) 
(27) 


This is analytic for the branch with y = 0 at x = 0, so that the formal 
expansions do have a positive radius of convergence. 

308. Parameters. If the functions on the right for a single equation, 
or a system of equations, are not only analytic in the set of n + 1 
variables x, yi but also in the set of n + k + 1 variables x, y^ Pj where 
the pj are k parameters, then the solutions are analytic in the k + 1 
variables x, pj. For, if p is a parameter, we may introduce an additional 
variable with the conditions: 


0, u(x Q ) = p. 


These make u(x) = p for all x, so that we may replace p wherever it 
occurs by u, and regard u as one of the variables. 

Again, the solution remains analytic if we consider the initial values 
as variables. For on making the change of variables indicated by 
equations (3) or (23), the initial conditions become fixed, the functions 
in the differential equations are analytic in x, t/ lt x 0 , y lt o and the values 
x 0 , yo or yi'O now appear as parameters, in which the functions are 
analytic. 

309. The Continuous Case. If we consider only real functions of 
real variables, and merely require the functions on the right of equations 
(1) or (19) to be continuous, we may show that the problems previously 
considered admit continuous solutions. We proceed at once to the 
system: 

~ = fk(x, 2/1, 2/2, • • ' , y n ), k = 1,2,3, • • •, n. (29) 

As before, we may consider the problem reduced to the case where the 
initial conditions are 2/*(0) = 0. 

We begin with an approximate solution defined by 

Vk,h{x) = 0, 0 3s * 2s A 

and 

9 Vk,h(x) «= f* fk[t, yijh(t — h)] dt, x > h. (30) 

Jo 
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With the notation here used, we assume the functions /*(x,y*) are 
continuous in all n + 1 variables in some closed n + 1 dimensional 
region including the origin. From the definition, the functions y k ,h 
are all continuous and so for sufficiently small values of x, say |x| < H } 
they will have values for which the integrand of equation (30) is in the 
region of continuity. For such values, the functions will all be bounded, 
say: 

L ft(x,y % )\ ^ M. (31) 


Hence, for any two values of x, xi and x 2 , with 


|xi| < H, (x 2 ( < H , 


we shall have: 


/» x : 

12/M (* 2 ) - Vk t h(x i)| = J f k [t, y hh (t - h)] 


dt 


g M|x 2 — Xi|. 


(32) 


(33) 


By taking an enumerable set of values of h decreasing to zero, for 
each value of k we obtain an enumerable set of functions. This set 
Vk,h(x) is equi-continuous, by equation (33). Hence by the theorem of 
Aseoli proved in section 254 we may select a subset of these functions 
approaching a limiting function. By doing this for fc = 1, then, using 
only the corresponding values of h in y 2f h(%), and so on we may find an 
enumerable subset of values of h > say h m such that: 


lim y k ,h n ( x ) = Vk(x), (34) 


uniformly in x for all k. Thus the limiting functions will be continuous. 
Also, from the uniformity, and the fact that h n -+ 0, equation (30) 
implies that: 

j7*(*) = f fk[t,y t (t)] dt. (35) 


Since the integrand of this equation is a continuous function of t, we 
have: 

= fk[x,V,(r)l (36) 

ax 

while from the form of equation (35) we see that 17* (0) = 0. Thus the 
existence of continuous functions which are solutions of our problem is 
established. 

310* Uniqueness* If the functions are merely required to be con¬ 
tinuous, there is not necessarily a unique continuous solution. For 
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example, if we seek to solve 

dy | 

-g- 3y 3 , with 2/(0) = 0, (37) 

the solution found by the process of the preceding section is 

y = 0. (38) 

However, the function 

y = x 3 (39) 

or any of the functions: 

y = (x + 6) 3 , a: < —5 < 0; y -0, —b < x < a; 

y = (x — a) 3 , 0 < a < x; (40) 

defined by a particular pair of positive numbers o and 6 are also con¬ 
tinuous solutions of the problem. 

If we require the functions /i(x,y t ), as functions of the y, to satisfy a 
Lipschitz condition of the first order, or to have bounded partial deriva¬ 
tives with respect to the y,-, then the solution is necessarily unique, as we 
shall now prove. 

For a function of k variables, the Lipschitz condition is 
\fk(x,Vi) - fk(x,Vi)\ gxi I y< - y,|, for |y, - y,| < A. (41) 

»«i 


If this condition is satisfied for all the k, then for |x| < L, 



[ fkfaiVi) fhi^jVk)] 


g LKn max |y,- — y,|. 


(42) 


Now consider two solutions, y* and y* each of which satisfies the differen¬ 
tial equations (36), and the initial conditions y*(0) = 0. Then each 
of these satisfies the equations (35), so that by the relation (42), 

Iy*(x) - y*(x)| g LKn max |y, ; - y»|. (43) 


Now take L\ = 1 /(2nK), and let Q be the maximum value of |y< — 
for all x in the interval |x| g Li, and i — 1,2, • • •, n. Then we find from 
the equation just written 

|y*(x) - jfc(x) | g ^ and hence OgQgy (44) 


This proves that Q =• 0, and the two solutions are identical in a finite 
interval ineluding the initial point. Hence, for |x| %. L\, the solution is 
uniquely determined. 

311. Extension of the Solution. If the functions /*(x,y,) are con¬ 
tinuous in a dosed region, R, and the minimum distance of the initial 
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point to the boundary exceeds D, then as long as x and all the $/*• do not 
differ by more than D/Vn + 1 from their initial values, the point will be 
in this region. Thus, if M in equations (31) and (33) exceeds unity, 
for \x — x 0 \ < D /(MVn + 1) the argument of section 309 will give a 
solution. If, for xi = x 0 + D/(MVn 4- 1) the values of y k {x x ) are 
such that the point is again at least a distance D from the boundary, the 
process may be repeated. Since R is closed, for some N any point with 
\x — x 0 \ > ND will lie outside R . Thus the solution may not be 
extended in R for x increasing indefinitely, and there is a greatest x* 
such that, for x 0 < x < x the solution may be extended with x,y k (x) 
remaining in R . If we took a new region R f including R in its interior, 
and defined the/*(£,?/») outside of R so as to be continuous in R', the 
solution could be extended in R f for x beyond x . This shows that as 
x —► x\ the point x y y k approaches a limiting point, necessarily on the 
boundary of R. 

If the functions/fc(x,t/i) are continuous in an open region, R 0) either 
the solutions may be extended for x 0 < x < <», or there is a greatest x' 
such that the solutions may be extended for x 0 < x < x where in each 
case the solutions are continuous and remain in R 0 . As x-^x\ the 
point x,yk need not approach a limiting point, but if it does this point 
cannot be in R 0 , and must be a boundary point. 

The extended solutions are unique if the Lipschitz condition holds for 
all points of some open region including all x,y k of the solution. 

Whenever the functions fk(%>yi) are analytic in their arguments 
throughout a closed region R y they possess partial derivatives which are 
bounded in R, Hence the functions satisfy a Lipschitz condition and 
the continuous solution of the differential equation is unique. Conse¬ 
quently, at each point it must agree with the analytic solution shown to 
exist in section 307. In this case the continuous solution is analytic 
throughout its extension in R. 

312. Differentiability. The argument of section 308 shows that if 
the functions /fc(x,y») are continuous, the solutions are continuous 
functions of the initial values x^y^. It also shows that if the functions 
contain any parameter, a, and the functions are continuous in the n + 2 
variables x y a and the y k taken together, then there are solutions con¬ 
tinuous in the parameter. Thus, if a Lipschitz condition is satisfied in 
all variables, this is the only solution, and the solution is continuous in 
the parameter. 

We may apply this fact to prove that, if the functions /* (x,yi) possess 
continuous partial derivatives with respect to all the variables, the solu¬ 
tion is a differentiable function of xo and y^o* Since devolutions are 
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continuous functions of x 0 and y,- t o, for a sufficiently small interval D, 
with |Axo| < D, |Ay 0 | < D and \x — x 0 | < D, the solutions x,y* for 
initial values xo,y*,o and x + Ax, yk + Ay* for initial conditions xo + Axo, 
3/fc.o + Ayicfl will all lie inside R, the region of differentiability of the 
functions/jt(x,yi). In consequence of this, by the mean value theorem 
of section 215, 

Afk = fa(x + A x,yi + Ay,) - /*(x,y,-) 


= Ax 


dfk 

dx 


+ 


^ A dfk 

Z Ay.- — 

dyt 


(45) 


where |« indicates that the partial derivatives are to be evaluated at 
x = x + 6 Ax,yi = y, + 0 Ay,-, with a suitable value of 6, 0 < 6 < 1. 

Now let us temporarily confine ourselves to partial derivatives with 
respect to Xq. We write: 


20 = 


and form the equations: 


Ax 
Ax 0 ’ 


Zk = 


A ijk 

Ax 0 


d,Zk Afk dfk JL, dfk 

— = —— = Zq - + Z 2,-- 

dx Ax 0 dx e i=i dy , e 


(46) 

(47) 


For any value of Ax 0 0, we may consider equations (47), together 
with 


dx 


— fk (x,Vi) 


(48) 


as a system of equations, and find a solution with the initial conditions 


x - x 0 , y* = y*.o, z 0 = l, z k = 0. 

If, for Axo = 0, we replace the system of equations (47) by 


dZk 

dx 


= Z, 


dfk 

dx 


+ Z z, 


i -X 


dfk t 

dyi 


(49) 

(50) 


where the partial derivatives are evaluated at x,y*, we may regard the 
extended system as containing a parameter, Axo, and the right members 
as being continuous in the variables together with the parameter. Thus 
there is a solution such that: 


lim Zu = Z k , when Ax 0 —»0. (51) 

But, for Axo 5^ 0, the solution of the system is unique, since the 
fk(x,Vi) possess continuous partial derivatives and hence for any fixed 
Axb, the functions A/*/Axo satisfy a Lipschitz condition. And, for 
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Ax 0 *** 0, the solution of the system is unique, since equations (48) 
have a unique solution, and since the partial derivatives of th efk(x,yi) 
are bounded the right member of each equation (50) satisfies a Lipschitz 
condition in the Z 

Finally, we note from its construction, if x,yk are the solutions of the 
original system of equations, (48), with initial values x = Xo, yk = Vk, o? 
then the solutions of the extended system for Ax 0 0 are given by the 
equations (46). This proves that: 

.. Ax Ayk 

lim -— = lim z 0 = Z 0 and lim -= lim z k = Z k . (52) 

Xo —►O AXf) xo—>0 AXo 

Thus the partial derivatives dx/dx 0 and dyk/dxo exist and satisfy the 
equations of variation , 

d (*Vk\ 

Wo/ = m 

dx dx 0 dx tx dx 0 dyi ’ 

formally obtained by differentiating the original equations partially 
with respect to x 0 . 

A similar argument proves that the partial derivatives with respect to 
yu ,o exist and satisfy similar equations. 

Also, by the device used in section 308, we may show that the solution 
may be differentiated with respect to a parameter, if the solutions have 
partial derivatives with respect to the variables and the parameter, 
continuous in all n + 2 variables. 

313. Envelopes of Curves. Let the equation of a family of curves 
in a plane containing a parameter be 

F(x,y,a ) = 0, (54) 

and suppose the function possesses partial derivatives with respect to 
x f y and a of the first two orders, continuous in these variables. The 
derivative, or slope of the tangent for any one curve of the family will 
satisfy the equation: 

F x + Fy^- = 0. (55) 

ax 

If, for a particular value of x,y,a which satisfies equation (54) we have: 

Fa 9* 0, (56) 

we may, by the theorem on implicit functions of section 217, solve the 
equation for a in terms of x and y, 

a = g{x,y), 


(57) 




m 


DIFFERENTIAL EQUATIONS 


[Chap. XV 


for values of x and y sufficiently near this value, and insert this function 
in place of a in the partial derivatives of equation (55). Suppose 
further that, for the particular choice of x,y,a, 

F\ ,(x,y,a) or F v [x,y,g(x,y)] ^ 0. (58) 

Then we shall have: 

dy = __ F x [x,y t g(x,y)} 
dx F v [x,y,g(x,y)] 

Our assumptions about the second derivatives of F make the right mem¬ 
ber of this equation differentiable near the x,y considered. Hence this 
differential equation has a unique solution. But the equation (59) is 
the condition that a curve should be tangent at a point to the unique 
curve of the family through the point. Thus in this case the unique 
solution must be the curve of the family itself. Consequently, when 
the conditions stated hold, there can be no envelope. 

If F v (x,y,a) = 0, but F x (x,y,a) ^ 0, we could reverse the r61es of x 
and y, and again show that there is no envelope. 

Suppose next that the family of curves (54) has an envelope, or curve 
tangent at each of its points to the curve of the family through the 
point, which curve has a parameter a varying smoothly as we move 
along the envelope. Then* we may take a as the parameter for the 
envelope, and write its parametric equations: 

x = x(a), y = y(a), (60) 

where each of these functions is differentiable. 

Then, since the point x,y is on the curve of the family with the parame¬ 
ter a, we have: 

F{x,y,a ) = 0. (61) 

As this must be identically satisfied when the equations (60) hold, we 
find on differentiating with respect to a, 

dx dv 

F -^ r '£ +F ‘-°- m 

This equation shows that we cannot have 

Fa 9* 0 , and F x - 0, F v - 0. (63) 

It follows from our discussion that: 

A necessary condition for the family of curves defined by 

* F(x,ti,a) = 0 , 


(64) 
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where F ( x,y,a ) is twice differentiable, to have an envelope, is that the points 
of the envelope satisfy 

F a {x,y,a ) = 0, (65) 

as well as equation (64). 

If, for values of x,y,a the Jacobian of the functions on the left in equa¬ 
tions (64) and (65) with respect to x and y is different from zero, these 
equations may be solved in the form: 

x = x(o), y = y(a). (66) 

Also, since the function F{x,y,a) is twice differentiable, the function 
F a (x,y,a) is differentiable, and the functions of equation (66) each have 
first derivatives. These satisfy: 

F x x'(a) + F y y'(a) + F a = 0, 

F„*'(a) + F av y'(a) + F aa = 0. (67) 

If the function F aa ^ 0, it follows from the second equation that 
x'(a) and y f (a) are not both zero, so that the curve defined by equations 
(66) has a tangent whose direction ratio is that of these two numbers. 
And, by equation (65) and the first of equations (67) we have: 

F x x\a) + F v y'(a) - 0. (68) 

By our assumption on the Jacobian, F x and F y are not both zero for the 
particular x } y,a considered. Hence the equation 

F x dx + F v dy — 0 (69) 

determines the direction ratio of the tangent to the curve of the family 
through the point considered, or equation (64) with a kept constant. 
A comparison of equations (68) and (69) shows that this ratio is the same 
as that for the curve (66). 

The discussion shows that: 

A sufficient condition for the family of curves defined by 

F(x,y,a) = 0, (70) 

where F(x,y,a) is twice differentiable, to have an envelope near a set of 
values x,y,a is that: 

F(x,y,a) = 0, F a (x,y,a) = 0, (71) 

and 

d(F,F a ) _ F x F v 

d(x,y) Fax Fay 

From the continuity of the derivatives, the conditions (72) hold 
throughout some interval including the given value of a, and the first 


5* 0, Faa ^ 0. (72) 
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condition insures that in a subinterval the pair of equations (71) have a 
solution which gives the envelope. 

Note that there may be an envelope even when the sufficient con¬ 
ditions are not satisfied. Thus, if 

(x-a)* + y 2 - 1 = 0, (73) 

the necessary condition for an envelope is 

F a = —4 (x — a) 3 = 0, or x = a, (74) 

so that if there is an envelope it must be 

y = 1, or —1. (75) 

These straight lines are in fact envelopes. However, the condition 
F aa ^ 0 is not satisfied. We may dispense with this condition, which 
we used only to show that x r (a) and y'(a) were not both zero, whenever, 
as here, we can show this directly. 

As a second example, consider: 

(x - a) 2 - y 2 = 0. (76) 

Here 

F a = ~"2(x — a) = 0, x = a, and y = 0 (77) 


is the only possibility. However, this is not an envelope. Here the 
Jacobian is 4 y, which is zero when the last of equations (77) holds. 

314. Partial Differential Equations of the First Order. We wish to 
prove an existence theorem for a partial differential equation of the first 
order. We consider the case of one independent and two dependent 
variables. We shall reserve subscripts for other purposes, and use the 
abbreviations: 


dz 

dz 

d 2 Z 

d 2 z 

d 2 z 


* dy’ 

dx 2 ’ 

S = , i 

dxdy 

dy 2 


(78) 


Then the partial differential equation we seek to solve is 

F(x,y,z,p,q) = 0. (79) 

We assume that this function is twice differentiable. 

We wish a solution containing the given curve: 

x = Xo (u), y = Vo(u), z = Zo(u). (80) 


Suppose that we are given the values of p and q at one point of this 
curve, determined by u * U, 

SoJo,5b,Po,?0 where F (x Q ,yo,z 0 ,po,b) = 0. 


(81) 
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Usually if one of these values is given, the equation will determine the 
other. In any case we have a pair satisfying this equation. 

Since, for any point in a surface, 

2 = /(*-«/). dz = ^fdx + pf dy, (82) 

ox dy 

and our solution must contain the curve (80), we must have 


dz 0 dx 0 dy 0 

T“ — Po 3 -r go — 

d u du da 


(83) 


Also, if we regard the surface which represents the solution sought as 
given in terms of the parameters u and v, we shall have, for v = 0 , 

F (zo>yo>Zo,Po>Qo) = 0 (84) 


The equations (83) and (84) can be solved for p 0 and g 0 in terms of u , 
for values near if the Jacobian: 


Po 
dx o 
du 


Qo 

dyo 

du 


* 0 , 


(85) 


where P and Q denote the partial derivatives of F with respect to p and 
g. If the condition (85) holds, equations (83) and (84) will determine 
functions: 

Po = Po(u) and q 0 = qo(u), ( 86 ) 

which reduce to p 0 and % for u = u. 

We shall now define the parameter v more precisely, by using the 
curves defined by 

M <*> 


as the projections on the x,y plane of the curves u = constant, and intro¬ 
ducing v by equating each of these to dv, 


From the relation 
we find 


dx dy 


dz = pdx + q dy, 


dz = dv(pP + qQ) and 


dz 


pP + qQ 


= dv, 


( 88 ) 

(89) 

(90) 


the value of the fractions in equation (88). 

Again, differentiating the function F partially with respect to * and y, 
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and using capital letters to denote the derivatives of F with respect to 
the corresponding small letters, as well as the abbreviations already 
defined in equation (78), we find: 

X + pZ + rP + sQ - 0, (91) 

Y + qZ + sP + tQ - 0. (92) 

But, 

dp = r dx + s dy, dq = sdx + tdy 

so that: 

dp 


dp 

and 


(rP + sQ ) dv = — (X + pZ) dv or 


~(X + pZ) 

dq 


(93) 
dv, (94) 


dq - (sP + tQ)dv = — (F + qZ) dv or 

— (r + 7^) 

On combining equations (88), (90), (94) and (95) we find: 

dx dy dz dp dq 

_____ - = 


dv 


dv. (95) 


(96) 


Q pP + qQ ~(X + pZ) -( Y+qZ ) 

This may be regarded as a system of five ordinary differential equa¬ 
tions of the first order with v as the independent variable, namely, 




(97) 


Let us now attempt to find a solution of equation (79), which includes 
the values given by equations (80) and (86). We proceed as follows: 
For any fixed value of u, the equations (80) and (86) will determine 
values of the five variables which we may associate with the value 
v <* 0, and take as initial conditions for the system (97). Since the 
function F was twice differentiable, the right members of the equations 
(97) are differentiable, so that the system has a unique solution for these 
initial conditions in some restricted region. We now regard x,y,z,p,q 
as five*dependent variables, unrelated except through the system (97). 

Thisrietermines five functions of the variable v for any fixed u, that is 
five functions of u and t>. If the Jacobian of the first two functions with 
respect to u and v is distinct from zero, for any value of u and v, then 

I dx dx I 



Art. 314] PARTIAL DIFFERENTIAL EQUATIONS 531 


and the first two equations 

x = x(u,v) 9 y = y(u } v), (99) 

can be solved for u and v in terms of x and y in the neighborhood of the 
particular values. For v = 0, the Jacobian of equation (98) reduces to 


dx o 

T> 


Po 

Qo 

du 

■M) 




dyo 

Qo 


dx 0 

dyo 

du 


du 

du 


in view of the equations (80) and the first two of equations (97). This 
will be different from zero if the relation (85) holds. Hence for the 
values of u considered, and any value of v sufficiently near zero, the 
equations (99) have solutions of the form 

u = u(x,y), v = v(x,y). (101) 

Using these equations, and the equations that give z, p and q in terms 
of u and v , we may express z, p and q in terms of x and y. We wish to 
show that the first of these relations actually gives a solution of the 
equation (79), 

We begin by showing that p and q } as determined here from the system 
(97) are actually equal to the partial derivatives of z. For the partial 
derivatives we have: 


dz 

dv 


dz dx dz dy ^ dz dz dx dz dy 
dx dv dy dv du dx du dy du 


( 102 ) 


Regarded as first degree equations in the partial derivatives dz/dx and 
dz/dy, these determine the values uniquely, since the determinant of the 
coefficients is not zero, being the Jacobian of the relation (98). Thus 
we may identify these derivatives with p and q if we show that the same 
equations are satisfied by p and q. 

Since we kept u constant in solving the system (97), the derivatives 
may be regarded as partial derivatives with respect to v, and from the 
first three equations (97) we find: 


dz dx dy 

— = v - h a —» 

dv F dv * dv 


(103) 


which is identical in form with the first equation (102). We shall 
establish the analogue of the second equation by showing that the 
function 


U(x,y,z) 


dx , dy 


if 

du 


(KM) 
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is zero. By equation (83), U = 0 for v = 0. To show that it vanishes 
for other values, we differentiate with respect to v and use subscripts to 
denote differentiation in this part of the argument. Then: 

U = px u + qy u - z ui (105) 

Uy = PXuV 4" QVuv “1“ PvXu "4 Qv%u Zui>. (106) 

Since the equation (84) holds for v = 0, we may differentiate it partially 
with respect to u, and obtain: 


F u — Xx u + Yy u + Zz u + Ppu + Qqu = 0. (107) 

We may also differentiate the equation (103) and obtain: 

&uv — px u v “4 QVuv “4 PuXv "4“ QuVv’ (108) 

By eliminating z uv from equations (106) and (108) we find: 

Uy — Pv%u “4 QvVu Pu%V QuVv (109) 

We may eliminate x„, y v , p v and q v by using the equations 

x v - P, yv = Q, Pv = -X - pZ, q v = -Y - qZ, (110) 
of the system (97). The result is: 

— U v = (X + pZ)x u + (K + qZ)y u + p u P + quQ • (HI) 

By equations (107) and (105) this may be written: 

— U v = pZx u + qZy u — Zz u — ZU. (112) 


Consequently, for u fixed, regarded as a function of v alone, U satisfies 
the differential equation: 


dU 

dv 


= -ZU. 


(113) 


This has a unique solution which is zero for v — 0, namely [7 = 0. 
Since we know that U — 0 for v — 0 for all values of u considered, it 
follows that, for all the values of u and v considered, 

U( W )-0 and + (114) 

Equations (103) and (114), together with (102) show that: 

and q = -- (115) 

We must now show that the values of x, y, z, p and q, where the last 
two are now identified with dz/dx and dz/dy, satisfy the relation F *= 0, 
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equation (79). By equation (84) we already know that this is satisfied 
for v = 0. And, if we differentiate F with respect to ?/, we find: 

Fv = Xx v + Yy v + Zz v + Pp v + Qq v . (116) 

Since the system (97) is satisfied, 

x v = P y y v = Q,z v = pP + qQ,Vv = -X - pZ,q v = -Y - qZ, (117) 
and 

F v = XP + YQ + Z(pP + qQ) - P(X + pZ) - Q(Y + qZ) = 0. 

( 118 ) 

Consequently, since F = 0 for t; = 0, it is zero for all values of u and v 
considered. Thus we have established the existence of a solution of the 
partial differential equation. 

We may formulate the result in the theorem: 

Let there be given a curve whose equation is: 



x = x 0 (u), y = 2/0(w), z = z 0 (u ), 

(119) 

and along it two functions 



V = Po(u), Q = Qo («), 

(120) 

such that 

dz 0 dx o dy 0 

du du du 

(121) 

and 

F(x 0 ,yo,zo,Po,qo) - o, 

(122) 

while 

Po Qo 

dxo dyo ^ 0, 

(123) 


I du du j 

where F{x,y,z } p } q) is a function of the five variables having continuous 
second partial derivatives , and capital letters denote first partial derivatives 
with respect to the small letters on the assumption that all five variables are 
independent. 

Then the partial differential equation: 



/ dz dz\ 

f ( w 'te'%)-° 

(124) 

has a unique solution 


2 = /(*,: y), 

(125) 

for which 


2o = f(xo,yo). 

(126) 
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The solution may be expressed^parametrically in terms of u, the parame¬ 
ter of the curve, and v, for sufficiently small values of v, by solving the system 
of ordinary differential equations: 


dx dy dz —dp —dq 

P “ pP + qQ ~ X + pZ = Y + qZ 


(127) 


We note that the values of Po(u) and qo(u) along the curve are deter¬ 
mined by their values at one point, by the conditions (121) and (122) 
in view of the condition (123). 

316. Other Partial Differential Equations of the First Order. A 

similar theorem may be formulated and proved for a partial differential 
equation in more than two variables, say 

dz 

*i, X 2 , • • • , x n , With — = Pi, (128) 

ox, 

so that the equation is: 

F{z,Xi,pi) = 0. (129) 


In this case the auxiliary system of ordinary differential equations is: 


dv = 


dxi 

K 


dz 

£ PkPt 

k~l 


-dp, 

Xi + PiZ’ 


i — 1 j 2, * * • j 7i 


(130) 


to be solved for initial conditions v = 0, and 

2o(«y), Xioiuj), p i 0 (Uj), j = 1, 2, • • •, n - 1. 
These values must be such that: 


and 


JL dXjQ , 

— = 3 = 1, 2, • • •, n - 1 

oUj t-i oUj 

F(zo,Xio,Pio) = 0. 


(131) 

(132) 

(133) 


The condition that insures the existence of a solution is the non¬ 
vanishing of the determinant: 


Pi Pz 

dxio 6X20 
du\ dui 


Pn 

6x n p 

du\ 


5 ^ 0 . 


(134) 


3*10 3*20 3*n0 


3u«_i 3u»_i 


3u»_i 
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This enables us, by reasoning similar to that for the two variable case, 
to identify the p» obtained from the system (130) with the derivatives 
dz/dxi. It is then possible to prove as before that the equation (129) is 
satisfied. 

In view of the equations (132) and (133), and the condition (134), the 
values of p»o(wj) are determined by their values for a particular set of 

Uj f U\) U2t ) Un—l' 

When the function F contains the derivatives p, only in terms of the 
first degree, the equation F = 0 may be written 

» q z 

£ Ai{z,x k ) — = C(z,x *), (135) 

«-l OXi 

where A , and C are functions of z and the n x k . Since 

F = £ AiPi - C; Pi « Ai and £ Pi P t = C + F. (136) 

i=l 

As the solutions of the system (130) which we seek make F = 0, they 
satisfy: 

dv = JF. = f 5 ’ »' = 1» 2, • • • , n. (137) 

Since the Pi do not occur in this set of equations, the remaining terms in 
equation (130) may be omitted, and we may use the simplified system 
(137) instead of (130) for the special equation (135). 

316. Envelopes of Surfaces. Let the equation of a family of sur¬ 
faces in space, containing a parameter, be 

f(x,y,z,a) = 0, (138) 

and suppose that the function possesses partial derivatives with respect 
to all four variables of the first three orders. Then the partial deriva¬ 
tives as determined from this relation will satisfy: 

f*P +/w+/z = 0. (139) 

Suppose that for a particular set of values of x,y,z and a for which 
equation (138) holds, the derivative 

f a (x,y,z,a) * 0. (140) 

Then we may solve the equation (138) for a in terms of x, y and zfor 
values near the particular set, and by substituting in the equation (139), 
obtain an equation : 

A(x,y,z)p + B(x,y,z)q - C(x,y,z) = 0. 


(141) 
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Now consider a curve: 

x = x 0 (u), y = y 0 (u), z = z 0 (u ) (142) 

which lies on the surface of the family with a = do, 

f(x,y,z,ao) = 0. (143) 

This equation will determine a value of p and g, Po(u) and g 0 (w), for 
each point of the curve. These values will satisfy: 

dzo dxo dy<) , , _ 

— = Po -h go — and A 0 po + B 0 q 0 — C 0 = 0, (144) 


where Aq *= A (xo,ijQ y z 0 ) } and similarly for S 0 and Co* 

If, further, 

-Ao Bo 

dx o dyp 
du du 

the partial differential equation (141) will have a unique solution for 
the initial values x 0 , i/o, *o, Po, Qo, which must be the surface given by 
equation (143), since this is such a solution. Thus there can be no 
envelope through a curve of the type described. 

Since the problem of an envelope is geometrical, the axes may be 
permuted, and the curve (142) can only lie on an envelope if 


5*0, 


dx 

du 

ot T. 


du 
96 7“ 

0 Jy 


(145) 


dx dy dz 

du du du 

fx fy ft 


(146) 


But, since the curve lies on the surface given by equation (143), we may 
differentiate this relation with respect to u to obtain: 



(147) 

It follows from the last two equations that: 


fx+fv+f'= 0 . 

(148) 

For real functions, this implies 


o 

11 

< 

i! 

ii 

< 

(149) 


so that the surface (143) can not have a uniquely defined tangent plane. 
If we exclude this case, we have shown that there can be no envelope 
whenever the condition (140) holds. 
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The discussion shows that: 

A necessary condition for the family of surfaces 

f(x,y,z,a) = 0 (150) 

to have an envelope is that 

fa(x,y,z,a) = 0, (151) 

if the function f (x,y,z,a) has continuous partial derivatives of the first three 
orders, and the equation (150) determines a unique tangent plane at the 
points of contact 

We shall now prove the following result: 

f or a particular set of values of x,y,z,a , satisfying the equations 


(150) and (151), we have: 


faa 7 ^ 0, 

(152) 

and some one of the Jacobians: 


d(fja) d (/,/a) d (/,/a) 

d(y,zj ’ d(z,x ) ’ d(x,y ) ’ 

(153) 


is distinct from zero , there will be an envelope near the particular set of values 
considered. 

For example, suppose that 

ttH * ( 154 ) 


Then, in the neighborhood of the particular set of values, we may solve 
the equations (150) and (151) for y and z in terms of x and a: 

y = y(x,a) and z = z(x,a). (155) 


These equations determine a surface. A direction in the tangent plane 
to this surface will satisfy the equations obtained by differentiating 
equations (150) and (151) partially with respect to x and a , namely, 

/* + fyVx + fax = 0, fax + fayljx + faz z x = 0, (156) 

and 

fa + fyVa + fz z a = 0, faa + fayVa + faz z a = 0. (157) 


From the condition (154), these equations determine unique values of 
yz,Zx‘,y a ,Za- These give rise to directions in the tangent plane: 


dx dy 

1 Vx 


dz _ dx 
and — 
z x 0 


dy _ dz 

Va Za 


(158) 


The first does not have all its components zero, because of the 1. The 
second does not have all its components zero, because of the condition 
that f aa 7 * 0, and the last equation (157). 
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These two directions, distinct because of the first components 0 and 1, 
determine uniquely the tangent plane to the surface given by equation 

(155) . Again, by the condition (154), /„ and /* can not both be zero, so 
that the surface given by equation (150) for a fixed value of a has a tan¬ 
gent plane, whose normal direction is 

Uv,U (159) 

The first direction (158) lies in this plane because of the first equation 

(156) . And, in view of equation (151), the first equation (157) may be 
written: 

/* • 0 + f y y a + /»z« = o. (160) 

This shows that the second direction also lies in this plane. Conse¬ 
quently, for a given a and x, determining y and z by equations (155), 
the surfaces (155) and (150) have the same tangent plane at x,y,z. 
For a given a the surfaces have only a curve in common, so that they are 
distinct. 

This proves that, under the conditions stated there is an envelope, 
obtainable from equations (150) and (151). 

317. Complete Integrals. Let 

F(x,y,z,P,q) = 0 (161) 

be a first-order partial differential equation, and let be a 

function containing two independent parameters a and b. Then if, 
for each value of a and b in a restricted range, 

f(x,y,z,a,b) = 0, (162) 

defines a particular solution of the partial differential equation (161), 
the relation (162) is called a complete integral of the equation. 

If we regard b as a function of a, 

b = g(a), (163) 

and if the conditions of the preceding section are met for the family: 

f[x,y,e,a,g(a)} = 0, (164) 

then this family of surfaces will have an envelope given by 

/a+/6?'(a) = 0, (165) 

combined with equation (164). Since this envelope, at each of its 
points, has the same value of x,y,z,p,q as one of the surfaces of the 
family (162), these values satisfy the equation (161), and the envelope 
is a solution of the differential equation. 

In a limited region, the differential equation (161) may be thought of 
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as dete rmin i n g at each point of space a set of values of p and q depending 
on one parameter, or a family of tangent planes enveloping a cone. In 
the process of section 314 we started out with a curve, associated at 
each of its points with a tangent plane touching a cone for that point. 
We chose this curve so that; 


P Q 

dx dy 
du du 


9 * 0 or 


dx dy 
du du 



(166) 


We then used this curve as the initial points of curves such that 

dx dy dz 

dy ^ dv dv 

P Q pP + qQ 


(167) 


These latter curves are called the characteristic curves of the partial 
differential equation. The condition (166) on the initial curve is, 
essentially, that it should not be tangent to a characteristic curve. A 
characteristic curve, with its tangent planes, given by equation (97), 
is called a characteristic strip. Two solutions which are tangent along 
a curve not a characteristic curve at any of its points, must coincide, 
since such a curve may be taken as an initial curve. However, by vary¬ 
ing the initial curve, but keeping one point and the tangent plane there 
fixed, we may obtain several solutions tangent along the same charac¬ 
teristic curve, or having a characteristic strip in common. Thus the 
characteristic curves may be distinguished as the curves where distinct 
solutions may be tangent. 

But the surface given by equation (164) for a fixed a, and its envelope 
are two solutions of the differential equation tangent along the curve 
where equations (164) and (165) both hold. Consequently, this curve 
is a characteristic curve. Thus the surfaces given by equation (162) 
are built up of characteristic strips, and the process of taking the enve¬ 
lope amounts to recombining these characteristic strips to form new 
surfaces. 

As an example, consider the partial differential equation: 

iL + _ z « o. (168) 

2 2 v ' 


Here the equations (97), or (127) become: 

dx _ dy _ dz dp _ 

V ~ q p 2 + q 2 P 9 


dv 


(169) 
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The solution in terms of initial values is: 

V = Poe v , q = qoC v , x - x 0 = p 0 (e v - 1), 
y ~ y o = qo(e v - 1 ), z- z 0 = §(po + 9o)(e 2 * ~ !)• (170) 

Since the initial conditions must satisfy 

z o = %(pl + qo), (171) 

the characteristic curves are given parametrically by 

x - x Q + po = 2/ ~ Vo + Qo = Qoe v , z = W 2 ”. (172) 

The curves are parabolas lying in vertical planes. 

The family 

2 z = (x - a) 2 + (y - b) 2 
is seen to be a complete integral of the equation. 

EXERCISES XV 

1. If f(x>y) is analytic in the two variables, /(xo, 2 /o) = 0 , and df /dy ^ 0 at 
xo f yo, the implicit function y — g(x) with yo = g(xo) defined by f(x,y) = 0 is 
analytic. Hint: It satisfies the differential equation dy jdx — —f x // v , whose 
right member is analytic. 

2. If the given functions are analytic, the implicit functions shown to exist 
in sections 217 and 218 are analytic. Hint: For f(y,Xi) = 0, the function is 
analytic in each Xi separately by problem 1 , and continuous by section 217. For 
a system, the argument by induction proceeds as in section 218, with the added 
condition of analyticity. 

3. A separable equation, dy/dx — A(x)B(y) has a solution given by 

X * r d V 

A(x) dx * I 777-7 , with y — b when x — a. This solution is unique if 
Jb B(y) 

A(x) and B(y) are each continuous and of fixed sign, never zero. Compare 
section 134. 

4. If in problem 3 B(b) - 0 , the other conditions as before, the expression 
gives a solution if the integral of 1 jB{y) exists. However, y ~ 6 gives a second 
solution. Show that B(y) does not satisfy a Lipschitz condition. Hint: Use 
section 310, or more directly note that if | B(y) — B(b)\ < K\y — 6 |, since 
B(b) «= 0, 1 J\B(y)\ > 1 /[K\y — 6|], and since B(y) is of fixed sign, 1 jB(y) is not 
iniegrable. 

6 . If f(x,y) is homogeneous of degree zero in x and y , the equation 
dy {dx * f(x,y) becomes separable (problem 3) if y is replaced by v where y =* vx. 
Hint: f(x,vx) ® x°f(l,v) ~ f(l>v) an ddy jdx = x dv jdx + v, 
d P j /" 2 "I 

8 * Show that — 1 — -- - - - --J = 0 is the differential equation of all circles in 

the plane. For the corresponding equations for parabolas and conics, 
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see problems 13 and 14 of Exercises IV. Hint: Deduce successively: 

y ”( 1 + p ' 2 )~ 3/2 = r ~~ l , y '( 1 + ?/' 2 )-*“ 1/2 = (x ~ a ) /r, 

y' = (* - a) [r 2 - (x - a) 2 ]- 1/2 , (x - a) 2 + (p - 6) 2 = r 2 . 


7. Prove that the evolute of a curve (see problem 12 of Exercises VIII) is 
the envelope of its normals. 

8. Any plane curve is the envelope of its circles of curvature. It is not the 
locus of limiting real points of intersection, since along an arc where the radius 
of curvature increases, no two circles of curvature intersect! Hint: By problem 
12 of Exercises VIII, the difference of the two radii equals the arc along the 
evolute between centers, and hence exceeds the chord joining the two centers. 

9. If the family of curves obtained by solving a first order differential equa¬ 
tion for different initial conditions has an envelope, this will be a solution. It is 
called a singular solution. 

10. Let G(c,x,y) = 0 define a family of solutions of a differential equation 
F(P> x >y) = 0, p = dy jdx. Assume that the functions G and F are each twice 
differentiable in all three variables. If there is a singular solution, problem 9, 
it will satisfy G(c,x,y) = Oand G c (c,x f y) = 0, or the equation C(x,y) = 0 obtained 
by eliminating c. It will also satisfy the equation P(x,y) = 0, obtained by 
eliminating p between F(p,x,y) = 0 and F p (p,x,y) — 0. This gives a practical 
method of finding possible singular solutions by testing those factors of the 
c-discriminant, C(x,y), or the p-discriminant, P(x,y) which equated to zero 
give solutions. Hint: Use section 313 and problem 9 for the c-discriminant. 
The other result follows from the fact that if OF /dp 0, there is a unique 
differentiable function p = f(x,y) with po — /(xo,f/o) and such that F(f,x,y) = 0. 
Thus the solution is unique, and there is no singular solution. 

[ n — 1 1 * 

——— (x — c) > 


and F(p,x,y) = p n 


y = 0, with n a positive integer §: 2. The singular solu¬ 
tion is y = 0. Note that if we w r rite the equation p — y 1,n — 0, and the solution 
n/( 1 — n) + (x — a) = 0, it illustrates problem 4, but problem 10 may not 

be applied to these functions, since they are not differentiable for y = 0. In 

X x C v dy 

A(x) dx - are not differenti¬ 


able at y = b, since B(y) — 0 and fails to satisfy a Lipschitz condition at y = b. 

12. Clairaut’s Equation , y = px + /(p), may be solved as follows. By differ¬ 
entiation, dy jdx « p + [x + /'(p)] dp /dx, and since dy /dx = p, [x + f(p)] dp /dx 
= 0. If dp jdx = 0, p = c and from the given equation y = cx + /(c), a family 
of straight lines. If x + /'(p) = 0, x = -/'(p) and by combining with the given 
equation y - /(p) — p/'(p). Unless /'(p) is a constant, when the lines pass 
through a point, the last two equations are the parametric equations of the enve¬ 
lope of the lines, and give the singular solution. In this case the c-discriminant 
and the p-discriminant of problem 10 are the same. Most simple examples of 
envelopes in elementary calculus and differential equations texts come under 
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problem 4 or Clairaut’a form, sometimes with a transformation of variables. In 
the Clairaut case, with new variables the family is v(x,y) «* cu(x,y) 4-/(c). 

13. The linear homogeneous equation of the nth order is 

L(v) - a»y (n) + a»_xy (n_1> 4-h a^y' 4- a 0 y *= 0, 


where the a, are functions of x, and a n 0. If «i, ut, ■ • •, u n are n functions of 
x such that L(«<) = 0, and the Wronskian 


W(u it Ut, ■ • •, u n ) 


Uj 

u? 

• u< 

< 

<4 ■ 

• • u\ 


»r°t4r°- 


u 


(»-l) 

n 


?* 0, for x ~ xo, 


ft 

constants Ci may be found such that y = £ c<u* is the solution of L(y) =* 0 

i*=l 

which equals 2/0 and has y (l!) = k « 1 , 2 , • * •, n — 1 , when x = x<>. 

14. A set of n functions Ui{x) are linearly dependent if for some set of constants 

n 

ki t not all zero, kiUi = 0 identically in x. If no such exist, the functions 
t~ 1 

are linearly independent. Show that if the Ui(x) are linearly dependent, 
W 2 , * * *, u n ) = 0, identically where W(wi) is the Wronskian defined in 
problem 13. Hint: The k{ are solutions of the n linear equations obtained by 
differentiating the given relation n — 1 times. 

15. The n solutions m of problem 13 are linearly independent, as defined in 
problem 14. Hint: By problem 46 of Exercises VI, W 7 * 0 for any value of x, 
so that by problem 14 the functions are not linearly dependent in any range. 

16. When the a*- of problem 13 are constants, the particular solutions may be 
found in the form e* 1 **, if m* are the distinct roots of a n m n + a„_im n “ l 4* * • • + 
aim + uo = 0, by problem 31 of Exercises V. Show that for x « 0, the Wron- 
skian reduces to II (m< — my), the product of differences of distinct roots, and 
so is 5 ^ 0. Hence, by problem 15, these solutions are independent. For multiple 
roots solutions xV*<* appear, and for x * 0 the Wronskian is a similar product, 
with hi^ier powers of the factors (m, — my) if m* or my is a multiple root. For 
the real form for complex roots see problem 32 of Exercises V. 

IT# If k linearly independent solutions, uy, of the equation L(y) = 0 of prob¬ 
lem 13 are known, the solution of the equation L(y) » /(x) may be reduced to 

& 

that of a similar equation of the (n — fc)th order. Put y = £ v i u i> and take 

j-i 

A (fa, / j 

E—{ — I tty ■=» 0 for r =* 0, 1, 2, • • •, k — 2. These conditions make the 
y-i ax \dxf 

terms which contain dry/dr disappear from the expression for dy/dx, cPy Idx 1 , 
■ ■ •, d*~*y jds^~ l found by successive differentiation of the first relation. Thus 
the highest derivative of the #, appearing in d*y ldx n is of order n — k + 1. To 
find die further conditions on the #/ which make L(y) «■ /(*), substitute these 
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expressions in this equation. The coefficient of Vj itself will be Liu/) which « 0. 
Hence, if we take z = dv 1 /dx as a new variable, we may solve the k — 1 assumed 
relations, linear in the dvj/dx for dv%/dx, • • • , dv% / dx in terms of z, and express the 
derivatives of the Vj up to that of order n — k + 1 in terms of z and its deriva¬ 
tives up to order n — k, linearly. Thus the relation Liy) = f(x) becomes 
M(z) * S{x), where M is a linear differential operator of the (n - fc)th order. 

18. Variation of Parameters. If n linearly independent solutions of the 
equation L(y) = 0 are known, the solution of L{y) = fix) may be found by 
integrations. Hint: The method of problem 17 determines each dv 7 jdx alge¬ 
braically. 

19. First order linear equation. The solution of dy /dx + yPix) = Q(z) is 
given by y = uv, where u = e~ pix and v = Qu* 1 dx. Hint: du/dx + Pu = 0 

is solvable by problem 3, and then problem 18, or 17 with no conditions, applies. 

20. If n — 1 linearly independent solutions of Liy) = 0 are known, the equa¬ 
tion Liy) ~ fix) may be solved by using problem 17 to reduce to a first order 
equation, solvable by problem 19. 

21. If one solution of Liy) = 0 is known, where Liy) = d 2 y / dx 2 4* Aix)dy /dx 
+ Bix)y is of the second order, the equation Liy) = fix) may be solved by 
problem 20. This is one method of completing the solution of Liy) = 0 when 
one solution has been found in series form, as in problems 10, 11, and 12 of 
Exercises XIII. With y = uv, where L(u) = 0, and dvjdx = z, the linear 
equation in z is u dz/dx + (2du /dx + Au)z = f{x). 

22. In applying the method of variation of parameters of problem 18, if we 

write Vj = I idv 7 /dx) dx or determine the constants in each v 7 so that 

t/a* 

n 

Vj(x o) — 0, the solution y = UjVj of Liy) = fix) is the one which, together 

i * 1 

with all its derivatives up to the (n — l)st order is zero for x = Xq. 

28. The solution of the linear equation with constant coefficients, Liy) = fix) 
obtained by the method of variation of parameters, problem 18, using m = 
in the distinct root case of problem 16 reduces to the sum of the solutions found 
in problem 33 of Exercises V. If we use an x 0 as in problem 22, and take x 0 = 0, 
either of these solutions becomes that found in section 305. 

24. The solution of any system of m equations in m variables y*, where each 
equation is linear in the y% and their derivatives d k yi/dx k , k^n may be reduced 
to the solution of a series of equations, each linear in one variable. Hint: If 
we regard y\ f dyx /dx, • • *, d n y/dx n as algebraic variables and differentiate each 
of the equations, we increase the number of variables by 1, and the number of 
equations by m. Hence, if m > 1, after a sufficient number of differentiations, 
yi and its derivatives may be eliminated, and similarly for the other variables 
until only one is left. 

25. A system of m linear equations in m variables with constant coefficients, 
by problem 24, leads to a series of equations in one variable with constant 
coefficients. These may be solved by problem 23. Or the method of section 305 
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20. The equation (ax + by + c) dx + (a'x + b'y + c') dy = 0, or more 

» 

generally the system dx\/L\ = dz^/L* = • * * = dx n jL n , where + 

Ci f is solvable explicitly, Put each fraction equal to dt, so that 

dzi/dt = Li, a system of linear equations with constant coefficients solvable 
by problem 25. 

27. Riccati’s eqmtion, dy /dx = P(x) + Q(x)y + R(x)y 2 , is reducible to a 
linear equation of the second order, d 2 u /dx 2 — (Q + R f jR) du /dx + PRu = 0, 
by the substitution y = — 1 /Ru du /dx. The Riccati equation is solvable if one 
solution is known. The solution is a linear fractional function of c , the constant 
of integration. Hint: A known solution tj\ leads to a known solution u\, and a 


second is found by problem 21 . If u = CiUi + c 2 «2, and c = ~ > 

Ci 


f . t 

u x + cu 2 
Ru\ + cRu 2 


28. The general linear homogeneous second order equation, 


d?y dy 

J ^0 


is reducible to a first order Riccati equation, dz/dx + B + Az + z 2 = 0 by the 
substitution y = e'f %zdx . This is less useful than the reverse procedure of 
problem 27. 

29. If a family of solutions of a second-order equation can be found which has 
an envelope with the same second derivative at each of its points as the curves 
of the family, this will give a singular solution of the differential equation. If 
G(x,y,a,b) = 0 gives the solution, and the envelope is obtained by replacing a 
and b by functions of a parameter, the equation for y f will be unchanged if 
G a a f + Gbb' = 0. This equation is G' = 0 , where G f = G x + G v y f . Similarly, 
the equation for y" will be unchanged if G' a a' + G'jb' = 0. Thus, assuming 
G v 0, a necessary condition for a singular solution is G a G' b — GbG' a = 0 . As 
an example, y = ae x + be~ x + ab is the solution of y" 2 + 4 y n — y' 2 — 4 t/ = 0 , tf 
obtained by eliminating the constants a and b. If G = ae z + be~ x + ab — y, 
G' ~ ae* ~ be”* — y\ and G a G' b — GbG' a - —ae x — be~ x — 2. Putting each 
of these equal to zero, and eliminating a and b gives: y n + ty + 4 * 0. This 
is more readily found as the discriminant of the differential equation, regarded as 
a quadratic equation in y n , or eliminant between it and the partial with respect 
to y f \ 2y ff + 4 = 0. Compare the p-discriminant of problem 10. The general 
solution of y* 2 + 4y + 4 = 0 is(x + k) 2 = — (1 + y). This is a singular solu¬ 
tion of the second-order equation. The first-order equation also has the singular 
solution y = — 1 , which does not satisfy the second-order equation. 

80* For the linear partial differential equation, 

dz dz 

A(x,y,z}— + B{x,y,z) — « C(x,y,z), 
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the equations for the characteristics are, by section 315, dv = dx I A = dy /B * 
dz 1C. In the discussion of section 317 applied to this case, the cones which the 
tangent planes must touch degenerate into lines, the tangents to the 
characteristic curves. Hence any surface through such a curve is a characteris¬ 
tic strip. If f(x,y,z) = Ci and g(x,y,z) = c 2 are two independent integrals of the 
system dx/A = dy /B = dz /C, and if F is any differentiable function of two 
variables, F(f } g) — 0 defines a surface built up of characteristic curves and 
hence is a solution of the differential equation. 

31. One complete integral of the Clairaut partial differential equation, 
2 = px + qy + f(p,q), is given by z = ax + by + /(a, b). 

32. In dynamics, Jacobi made use of the partial differential equation 
dV /dt + H(qi, dV/dq if t) = 0. Here V is a function of t and the nqi. With 
Pi — dV Idqi , the equations (130) of section 315 are: 


dq { 

dV 


-dpi 

dll = 

" dV * dH 

dH 

dH 

dpt 

Pi T 

dt dpj 

dt 

dq: 


Thus, along a characteristic, the Hamiltonian equations: 


dqi 

dt 


dll d Vi dH 

— and — = — ~ , are satisfied. 

dpi dt dqi 


33. If Ui and u 2 are two linearly independent solutions of the second order 
linear equation L(y) = 0 of problem 21, the zeros of u\ separate those of w 2 , in 
the sense that if u\(a) = u\(b) = 0, « 2 is not zero at a or 6, but is zero at some 
point c between a and b . Hint: Use problems 14 and 15, and problem 9 of 
Exercises IV. 

34. For a given function of five variables, /Or,?/, 2 ,a,6), let J denote the Jacobian 
of f a and fb with respect to x and y, when z is considered a function of x and y r 
so that 

j _ fax + Pfaz, fbx + Pfbx I . 

fay + 2 / azy fby + qfbz | 

Show that, if /, 0 and J ^ 0 there is a partial differential equation 

F(x,y,z,p,q) = 0 of which }{x,y,z,a,b) = 0 is a complete integral. Hint: Since 
/, t* 0, the equation may be solved for z, and p and q are uniquely determined 
from U + pf, = 0, /„ + qfz = 0. Since J 9* 0, these equations may be solved 
ior a and b in terms of x,y,z,p,q, and substitution in / gives F. The function 
f(x,y,z,a,b) contains two independent constants, since if it equalled f(x,y,z,c) 
with c = c(a,b),f a = Ua and f b = fcC b would imply J = 0. 
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THE GAMMA FUNCTION AND OTHER 
DEFINITE INTEGRALS 


It is often desirable to use asymptotic expansions for functions which 
facilitate their computation for large values of the argument. We 
develop a general theorem on such expansions, the Euler-Maclaurin 
sum formula, after introducing the Bernoulli numbers and Bernoulli 
polynomials which are related to it. 

We then apply the sum formula to the computation of Euler’s con¬ 
stant, and to the development of Stirling’s formula for the factorial 
function, as well as the Gamma function, I'(2). This function is first 
defined for positive real values of the argument by an integral between 
fixed limits containing the argument as a parameter. It is a gen¬ 
eralization of the factorial function, since for a positive integer n, 
T(n + 1) = n !. We obtain some alternative expressions for the 
Gamma function. In particular, we find an expansion for the reciprocal 
of the Gamma function as an infinite product. This shows that T(z) 
has simple poles when z is zero or a negative integer, and is analytic for 
all other finite values of z. 

The Beta function is defined as a definite integral between fixed limits 
containing two parameters. It is expressible in terms of Gamma func¬ 
tions. 

Finally we discuss briefly, and give asymptotic expansions for a few 
of the more common non-elementary integrals. 

318. Bernoulli Periodic Functions. As a first step toward the study 
of the Bernoulli numbers and Bernoulli polynomials, which are impor¬ 
tant for certain theorems on expansions, we here define the Bernoulli 
periodic functions, Pk(x). We begin by expanding the function x — \ 
in a Fourier series of period unity, which represents it in the interval 
0 < x < 1. The periodic function defined by this series is odd, so that 
the series is the sine series for x — § for the interval 0 < x < J, obtain¬ 
able by problem 11 of Exercises XIV: 


x - \ 


" sin 2 nirx 

r-> 

n-i nir 


0 < x < 1. 


( 1 ) 


Pl(x) 


* sin 2 nirx 

L _ 

n—1 nv 


Now define 


( 2 ) 
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for all values of x. Then Pi ( x ) is of period unity and is continuous for 
all values different from 0 or an integer. We have 

Pi(l-) = i Pi(l+) = Pi(0+) = and PiCl) = 0. (3) 

Thus the function Pi (a;) has discontinuities at zero and all the integral 
points. 

Next define P%(x) as the function equal to the trigonometric series 
obtained from the series (2) by formal termwise integration, with the 
constants of integration omitted, namely, 


P 2 (s) = 


oo 


L 


cos 2utx 
2n 2 7r 2 


(4) 


Repeat this process, defining the function P k + X (x) by the series obtained 
from that for P*(x) by integrating termwise, and omitting the constants. 
Thus: 


and 


P 2fc (x) = (-1)*- 1 



cos 2nirx 

2k—l n 2k T 2k 


P2k+l(x) = (-I)'- 1 


00 


£ 


sin 2mrx 

22k n 2k+i T 2k+i ' 


(5) 

( 6 ) 


Since all the series except that for P x (x) are dominated by £l/n 2 , for 
all values of x, they converge uniformly and thus have as their sums con¬ 
tinuous functions. Thus, for k £: 2, all the functions P k (x) are con¬ 
tinuous functions for all values of x. We may obtain the Fourier 
coefficients of the functions by termwise integration of the series, after 
multiplication by factors 1, sin 2nirx or cos 2 rnrx. For, since these 
factors are numerically at most unity they do not disturb the uniform 
convergence. This shows that the coefficients of the expansions (5) 
and (6) are Fourier coefficients, and these series are the Fourier series of 
the Bernoulli periodic functions. 

As all of these functions, including Pi (x), are functions whose squares 
are integrable, by section 297 their Fourier series converge in the mean 
to the functions, and the series obtained by termwise integration over 
any finite interval converges to the integral of the function. Thus, from 
the method by which P*+i 0*0 was obtained from P k (x) , we have 

Pk(x) dx = Pk+i(x) - Pt+i(a). (7) 

This shows that, at all points of continuity of P t (x), 

Pk(x) = ^ [Pt+i 0*01 = P'k+i(.x). 


(8) 
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Thus this equation holds for all values of a; if k > 1 , and for all non¬ 
integral values of x if k = 1 . 

If we put a — 0 , x = 1 in the relation (7), and recall that P*+i(x) is 
of period unity, we find: 

f P k (x) dx - 0 . (9) 

Jo 

The equations ( 8 ) and (9) enable us to determine expressions for the 
value of Pjt(x) in the interval 0 , 1 . We first note that for 0 < x < 1 , 

P' 2 {x) = x - i P 2 (x) = X 1- X - + C, (10) 

and since 

f P 2 (x) dx — 0, C = --> (11) 

This shows that: 

.***(*) - ~ ^ + ^> 0 < x < 1 . ( 12 ) 

By the same procedure we find that 

Pz(x) = + 0 < x < 1 . (13) 

We could continue in this way to find a sequence of polynomials such 
that the &th one is of degree k } and equals Pk(x) in the open interval 0 , 1 . 
For k > 1 , we could use the closed interval 0,1 since both Pjt(x) and the 
polynomial of the kth degree are continuous at the end points. These 
polynomials are called the Bernoulli polynomials . 

319. Bernoulli Polynomials. We denote the Bernoulli polynomial 
of degree k by 2 ?*(z), so that: 

Bi(x) = x - B 2 (x) = + CtC ' ( 14 ) 

Practical methods of finding the B k (x) for larger values of k will be 
given in section 321. We complete the sequence at the beginning by 
putting 

B 0 (x) « B[{x) = 1 . (15) 

From this and equation ( 8 ) 

1 (*) *= Bi t(x) for k = 0 , 1 , 2 , • • •. 


(16) 
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From equation (9), 



dx = 0 for k = 1 , 2 , • • * . 


(17) 


This does not hold for k = 0. 

The expansion (5) shows that the function P 2 *(l — x) = P 2 fc(a;). 

If we put u - x — x = ^ | and 1 ~ x = —u + Thus 

+ 2 ) is an even function of w. Hence B 2k (x) will be an even 

function of u = x — J for \u\ < \ ) and hence for all values. Thus, if 

B 2k (x) is expressed in powers of (x — §•), only even powers will appear. 
Similarly, if B 2 k+i (%) is expressed in powers of (x — J), only odd powers 
will appear. 

For polynomials of index at least 2, B k (x) = P fc (:r) on the closed 
interval 0,1. Hence, from equation ( 6 ) 

B 2 k +i( 0 ) = B 2k .±i ) =« # 2 * 4-1 ( 1 ) = 0 , k = 1 , 2 , • • • . ( 18 ) 


And, from equation (5): 

00 1 

B 2k ( 0 ) = B 2 k(l) = ~2k-l 2k ~2k f 

A 7T n — 1 U 


Equation (18) shows that, in the closed interval 0,1 each polynomial 
of odd index at least 3 has the three zeros 0 , 1 . Moreover, it can have 

no more, since if any odd polynomial # 2 * 4 - 10*0 had an additional root, 
by Rollers theorem, its derivative B 2k (x) would have a root between 
each pair of those of # 2 * 4-1 0*0- Thus B 2k (x) would have at least three 




Typical shapes of B k ( x), k> 2. 

Fig. 27. 

roots in the open interval 0,1 and by similar reasoning B 2k -~i(x) would 
have at least two roots in this open interval, and hence with 0 and 1 at 
least four roots. Continuing in this way, we would come to a contra¬ 
diction since B 2 (x) } being of the third degree, can have only three roots. 
The reasoning also shows that no even polynomial B 2k (x) can have more 
than two roots in the interval 0,1. By considering # 2 * 4 - 1 0*0, and using 
Rollers theorem, we see that it has two, one in each of the open intervals 
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Q,J and §,1. In fact, since B 2k (x) is an even function of « = * — it 
follows that they are symmetrically disposed about the point §. Hence, 
in the closed interval 0 ; 1 each odd function of index at least 3 has three 
roots given by equation (18), and each even function of index at least 2 
has two roots, separated by these. Hence all these roots are simple, 
since no function has a common root with its derivative in the inter¬ 
val 0 , 1 . 

320. Bernoulli Numbers. The Bernoulli numbers are defined in 
terms of the Bernoulli polynomials by putting: 

B n — n\ B n (0). (20) 

We take 0 1= 1 , so that B 0 = 1 . The method of computation already 
indicated shows that the coefficients of the polynomials, and hence 
B n ( 0) and B„ are all rational numbers. Also, for odd subscripts, 

B\ — ^ and B 2k +i ~ 0, k = 1, 2 , 3, • • •. (21) 

The first few B n with even subscripts are: 

B» = - , Ba = - —, = —, B* = - — ,- (22) 

2 6 30 ’ 42 ’ 30 ’ ' 


The signs alternate, as we see from equation (19). 

Since the series with term 1 /n 2k , for k ^ 1, is dominated by the series 
£l/n 2 , it converges uniformly in k. Hence 


lim 

Jfc —*>00 


f± 

t n* 
n»l n 



(23) 


Thus, from equation (19), 


lim B 2k (0 ) = 0. 

*-+oo 


However, we have: 

lim \B 2 k\ — lim 

*—►00 k —*00 


(2k) ! 

2 2k-i v 2k 


(24) 

(25) 


since for k — p + q, with p fixed but >2x, we have: 


(2k) 1 
2?k-\u 


> 


(2p)l 

22p-l 7f 2p 


2 2 «, 


(26) 


which becomes infinite when q becomes infinite. 

321. Recursion formulas. We proceed to prove that the Bernoulli 
polynomials may be symbolically expressed in terms of the Bernoulli 
numbers by the formula: 


B n (x) m 


±(x + B)', 
n I 


(27) 
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where in the expression on the right, each power of B, B k is to be replaced 
by the fcth Bernoulli number, B*, after expansion. It follows from 
equation (27) that the polynomials B n (x) defined by it satisfy the 
relation: 

B'n+ 1 (*) - (x + B)» = B n (x), (28) 

n I 

the differentiation rule for the right member persisting just as if the B h 
were powers of a constant, since no combination of separate powers is 
made. 

But, the equation (27) gives the correct value for the first two Ber¬ 
noulli polynomials: 

B 0 (a;) = 1, B x {x) = x - |, (29) 

so that when the remaining polynomials are determined in succession 
by integration, in accordance with equation (28), they must give the 
same value as before, except perhaps for the constant of integration. 
But this is right, since equation (27) makes 

B„(0) - — , (30) 

n ! 

and the Bernoulli numbers were defined by this relation. This com¬ 
pletes the proof that the polynomials B n (x) defined by the relation (27) 
are the Bernoulli polynomials. 

For n at least 2, it follows from equations (18) and (19) that 
B n ( 1) — B n (0) = 0. From this and equation (27), we have: 

(B + l) n — B n = 0, ft = 2, 3, • * •. (31) 

If we put n = 2k + 1, expand and use equation (21) as well as Bq = 1, 
we find: 

(2k + l)B 2 k + 2 k + l CzB2k-2 + 2 k + l C&B2k-4 + ' * * 

+ 2fc+1 C 2k _iB 2 + (2fc + 1)(—|) + 1 = 0, k = 1, 2, • • •. (32) 

This may be used as a recursion formula to compute the Bernoulli 
n u mbers with even subscripts. In succession, each B 2 jt is given as a 
linear combination of those already found. The values given in equa¬ 
tion (22) may be checked by this process. 

After the Bernoulli numbers have been found, the Bernoulli polynomi¬ 
als may be obtained from equation (27). 

We may use the symbolic relations (27) and (31) to establish the 
generating functions for the Bernoulli numbers and polynomials. Let us 
start with 


e (fl+u( _ giv. 


(33) 
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This relation holds if B is a number, and hence the coefficients of B n 
on both sides will be the same functions of t. Thus, the relation con¬ 
tinues to hold as a formal identity if B n is replaced by B n . But, for this 
interpretation of B n , we have in consequence of equation (31): 

e tB+i)« _ e» = t) (34) 

where the term on the right results from the relation 

(B + l) 1 — B l = B x + 1 — B, = 1 , (35) 

which replaces equation (31) for n = 1. 

From the symbolic equations (33) and (34), we have: 

e*V “ 1) = t> (36) 

as a formal identity when B n is replaced by B n . Hence: 



2 * Bn . ■ 

»=o n ! 


(37) 


Thus the function on the left is a generating function for the numbers 
B n fn !, since these are the coefficients of its expansion. 

Analogous to equation (33), we have 

c (B+ *) f = e Bt t xt } (38) 

which may be used in conjunction with equation (37) to deduce: 

e xt e m « e {B+x)t = £ (B + x) n — t 

n — 1 H ‘ 

£ B n (x)t n , (39) 

n = l 

by equation (27). Thus the function on the left is a generating function 
for the Bernoulli polynomials. 

The equation (37) enables us to find the coefficients of the power 
series expansions of several related functions in terms of the Bernoulli 
numbers. In particular t coth t, tanh t, t csch t as well as t cot t, tan t, 
t esc t are such functions. Similarly the coefficients of the expansion of 
sech t and sec t may be expressed in terms of the Bernoulli polynomials 
by means of equation (39). For the details see problems 8 through 11 
of Exercises XVI. 

322. Euler-Maclaurin Stun Formula. We shall now prove a formula 
connecting the integral of a function with a finite sum. We assume that 
the function,/(a:), for all the real values of x considered, has continuous 
derivatives either of all orders, or at least of all orders up to the last one 


te xt 

e l - 1 
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written in any of our equations. Then, in consequence of equations ( 1 ) 
and ( 2 ), we have for any integral value of fc, 


s%k- f-1 

f(x) dx — I }{x)P[ (x) 

k l 


= f(x)P\ix) 


I k+ 1 - 1 


X rc-T-i 

Pi(x)f(x)dx, (40) 


by an integration by parts. By equation (3) and the fact that Pi(x) is 
of period unity, this may be written: 

“$[/•(*+1)+/(*)]- / Pi(x)f'(x)dx. (41) 

k k 

By equation ( 8 ), we may replace P\{x) by P 2 {x). We again use an 
integration by parts to obtain: 

r +i k+i r k +1 

P 2 {x)f{x) dx = f'(x)P 2 (x) - / P 2 (x)f"(x) dx 

k J k 

T> + l 

- 2 1 f/'(* + ] ) - /'(*)] - J dx, (42) 


P 2 (k + 1) = P 2 (k) = P 2 (0) = B 2 (0) = (43) 

When we continue this process, the integrated terms from the polynomi¬ 
als with odd subscripts will vanish in view of equation (18). Thus we 
find: 


r k+i 

J f(x)dx = Uf(k + v+m] 


-hi+ 

r=i (2r)! 

1 

P 2 n(x)f i2n) (x)dx. (44) 

h 

If we sum both sides of this equation, after making k = 0, 1, 2, • * * , 
m — 1 , we find: 

J f%m m—1 

fix) dx = |[/(0) + /(m)] + z /(&) 

0 & = 1 

- f/ (2r_1) (rn) - (0)] + fin. (45) 

r=l (2r) ! 
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The remainder after the terms written explicitly is 

Rn = r P 2 n(x)f ( - 2n) {x) dx. (46) 

t/o 

Let us incorporate the last term of the sum: 

^t/ (2n_1> (m) - / (2n - X) (0)] - P 2«(0) jy™ (x) dx, (47) 
with the term R n , to give: 

Rn —i « r[PM - P 2n (0)]f (2 *Hx) dx. (48) 

From equation (5) we see that P 2 * (0) is a maximum of the function 
P 2 *(x) when A; is odd, and a minimum when A; is even. Hence, in all 
cases the factor [P 2n (x) — P 2n (0)] never changes its sign, and by the 
theorem of section 125, the remainder is: 

= / (2B) (*m) f [P 2 „ (X) - P 2n (0)] dx, (49) 

•Jo 

where 0 is a suitably chosen number between 0 and 1. In view of equa¬ 
tion (7) this may be simplified to 

Rn —i - -/ (2n) (0m)mP 2n (O). (50) 

Thus we finally have the Euler-Maclaurin sum formula, 

Cm dx = |LT(0) +/(m)] + zV(fc) 

«A) *-l 

- Z ■^ L j[/ (2r_I> (m) - (0)] - / (2n) (6m)m ^ • (51) 

Collectively, the terms involving derivatives express the error made 
in computing the integral by the trapezoidal rule for unit intervals. 
The case of equal intervals not unity could be treated by a change of 
scale, u * hx. 

As written the equation expresses an integral in terms of a sum and a 
remainder term. We may also think of it as expressing a sum in terms 
of an integral and certain additional terms, together with a remainder 
term, by writing: 
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We may use this formula to sum the powers of the integers, x p , 
where p is a positive integer. In this case the equation may be written: 


m—1 W P+1 

Z = -— 

ft1 P+1 


where, 


- \m v 

+ £ 


r = 1 


^2r 

(2r) ! 


p(p - 1) • • • (p - 2r+2)m p_2r+1 , (53) 


for P odd, and “ for p even. 


(54) 


The terms on the right, combined, equal: 

—L_ (m v+1 + p+1 Cim p B\ + £ p+1 C 2r m p+1 - 2r B 2r S j, (55) 

where the C ’s are binomial coefficients. And, since the B k with odd 
subscripts greater than 1 are zero, this is the expansion of 

—~ Km + B) p+1 - B p+1 ], (56) 

p + 1 

with B k replaced by B k . Hence, by using equation (27), we find: 

Z 1 k p = p ! [B p+1 (m) - B p+1 (0)]. (57) 


In the sum formula (51), a useful conclusion may be drawn about the 
relation of the remainder to the size of the last term retained, provided 
that, for the orders used, the even derivatives of f(x) are all positive on 
the interval considered, 0 to m. If we denote by t n the term in equation 
(45) involving B 2n , we have 

Rn—l — tn + Bn • (58) 

Our assumption, together with equation (50), shows that R„ and Rn-i 
are each distinct from zero. And, since the signs of P2n(0) alternate, 
R n and R n -i have opposite signs. Thus: 

|<„| = \Rn\ + |Pn_l|, (59) 

and R n and Rn-i are each numerically less than t n . Consequently, from 
equation (58), R»-i has the same sign as f„. 

A similar conclusion holds if the even derivative of f(x) are all nega¬ 
tive. Also, if f(x) and all the derivatives used approach zero for x —► «, 
and the even derivatives are all different from zero and of the same sign, 
the formula holds with m - » if the sum and integral converge. In all 
these cases, the remainder term is numerically less than the first term of 
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the serf® omitted, and has the same sign as this term. For the limits m 
and », the sum formula becomes: 

Z /(*) = f f(x) dx + \f(m) - Z 77 T L i/ (2r_1) ( wl ) ~ (60) 

k~m r-1 (2r) ! 

This applies if the conditions hold for x > m. For example, we may put 
f(x) ~ x~~ p , p > 1 \rith m > 1 to avoid the discontinuity at 0. We thus 
find: 

ktn V- 1 + 2m p 

+ "z m-P- 2r +V(p + 1 ) • • • (p + 2 r - 2 ) - ( 61 ) 

r«=l (2r) ' 


The infinite series obtained by letting n become infinite diverges. In 
fact the terms ultimately increase numerically, as may be shown by 
reasoning similar to that used to establish equation (25). However, 
for any finite value of n, the sum gives an approximation to within the 

magnitude of the first term neglected. The series may be used to com- 
00 

pute £ by actually adding up the first m — 1 terms, and using 

equation (61) to calculate the remaining part of the sum. If m is fairly 
large, say > 10 , a relatively few terms will give a good approximation. 
Expansions, whether convergent or not, are called asymptotic expansions 
if for a fixed number of terms, the remainder approaches zero when some 
parameter becomes infinite. In the case of equation (61), »0 

when m —* , so that this is an asymptotic expansion. The sum formula 
(60) frequently gives asymptotic expansions. 

323. Euler’s Constant. The sum and integral in equation (60) 
diverge if f(x) = 1/x, m 1. However, the limit process which estab¬ 
lished equation (60) shows that: 



Rn~ 1 . (62) 


Tor ra = 1, the limit in the left member is known as Euler’s constant, 
and is denoted by y, so that: 

V a® lim 6 + 5 + ; + --- + i;-logJlfV (63) 

m~+oo \ 2 3 M / 

That the limit in equation (63), and hence that in equation (62), exists 
follows from the Cauchy convergence criterion, and the sum formula 
from which (62) was obtained, taken between Ua ******** a# 
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elementary proof, compare problem 9 of Exercises IX. By combining 



with equation (62) we find that: 

7 = £ 7 - log m - — + mr 2T - En-i. (65) 

t-i k 2 m r=1 2r 

For any fixed m, and n — •> oo, the series diverges. But R n —i is 
numerically less than the first term omitted, and since this approaches 
zero for any fixed n, when m —> qc , the series is an asymptotic expansion 
for 7. It may be used to compute 

7 - 0.5772157 • • •, (66) 

for example by taking m - 10 as in problem 14 of Exercises XVI. 

324. Stirling’s Formula for Factorial m. For positive integral 
values of m, 

m 

ml - 1 • 2 * 3 • • • m, and log (m !) = £ log k. (67) 

k=l 


Thus we may use the methods under discussion to obtain an asymptotic 
expansion for log (m !). We put/(r) =» log x in the sum formula (52), 
with lower limit 1, and find: 

m—1 


52 log k = m log m — m — \ log m + 1 

*-l n-1 

+ 22 


B 2r (ni 


2H-1 


1 ) 


(2r)(2r - 1) 


Rn- 1. (68) 


By equation (46), the remainder after one term is here: 

/ m P m Po(x) 

P 2 (x)f ff (x) dx ^ J -- - 2 ■ ■ dx. (69) 

Since the Bernoulli periodic function P 2 (x) is bounded for all values of x 
this integral is dominated by that of a constant times x~ 2 } and so con¬ 
verges for m — > «> . This shows that 

lim [log (M !) — (M + J) log M + M] = K (70) 

M-+ oo 

exists. Moreover, if we apply the sum formula from rn to M, and let M 
become infinite, we find, analogous to equation (65): 

K = log (m !) - (m + J) log m + m 

B 2r nT 2r + l 
h (2r)(2r - 1) 




(71) 
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This equation could be used as an asymptotic_expansion for K. How¬ 
ever, we shall prove that, in fact, K = log \/2ir, so that instead we use 
this expansion to calculate log (m !) for large values of m. 

To evaluate K, we recall the product expansion for sin z, 


sin z - z II (l- 5 - 0 Y 

n-X \ n IT / 


of section 285. For 2 = ir/2, this gives: 


-r 00 r I 

1 as - IT 1_— . 

2 nix L (2n) 2 J 


But, for the product to m terms: 

ff — ~ 1)(2W + = 1 - 3 ' 3 ' 5 --- (2m ~ l)(2m+l) 

»-i (2n)(2n) “ 2 • 2 • 4 • 4 • • • (2m) (2m) 

, ( - 2m) ! J 2to .± l 2 ! . (74) 

(m !) 4 2 4m 

By using equation (70) with M = 2 m and M — m, we find that as 
m —*■ 00 the limit of 

log p„ ■* 2 log (2m) 1 + log (2m +1) — 4 log m ! — 4m log 2 , (75) 

equals the limit of 

2 ( 2 m -f §■) log 2 m — 2 ( 2 m) + 2 K + log ( 2 m + 1 ) 

— 4(m + §■) log m + 4m — 4iv — 4m log 2. (76) 

Consequently: 

lim (log p m ) = lim £log ~~~ + log 2 — 2JtJ = 2 log 2 — 2f£. (77) 

On combining this with equation (73), we have: 

0 - log 5 + lim (log p m ) = log 2 tt - 2 K, (78) 

so that 

K - £ log 2 tt - log V27, (79) 

as we stated. 

We may deduce from equations (70) and (79) that 

m! „ 

11111 " 7 — * 1 . (80) 

The denominator of this expression is known as Stirling's formula for 
factorial m. In evaluating a limit involving m ! as a factor, we may 
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replace m 1 by v / 2irm m+i e~ m . Equation (80) suggests that Stirling’s 
formula gives an approximation to factorial m with a small percentage 
error for laige values of m, and actually the percentage error is small 
even for moderate values of m. Compare problem 15 of Exercises XVI. 

325. The Gamma Function for Positive Real Values. We have 

lim x^e - * = 0 (81) 


for all values of p, by section 92. It follows that for a sufficiently huge 
value of M depending on p, 


|x p ~V 

*| < x -2 , X > M. 

(82) 

Thus by section 166 the improper integral 


j 

f x v l e x dx 

(83) 

converges for all values of p. 

Again, since for positive values of x 


X p-i e -x < x p- 

the integral 

(84) 

j 

f x p ~ 1 e~ x dx, 

0 

(85) 


which is improper for p < 1, converges if p is positive. 
It follows that if we set 


t(p) 


= f x p ~ l e~ x dx = f t r-'f* dt, p > 0, 

Jq Jo 


( 86 ) 


the function F (p) will be defined for all positive values of p. It is called 
the Gamma function, as we anticipated in the notation T(p). 

For o and b positive, we may integrate the proper integral by parts to 
obtain: 



x v e * dx 


-x p e~ x 


b -.b 

+ p I x^e - * dx. 

a J a 


(87) 


If p > 1, and we let a -* 0 and b —* «, this equation leads to: 

r(p + l) = ?r(p), p > o. (88) 

By repeated use of this relation we find: 

r(p + l)-p(p-l)---(p-*)r(p-fc), p>k. (89) 

In particular, if p is an integer, n, we find: 

T(n + 1) - n(n - 1) • • • 2 • ir(l) - n !, 


since direct integration shows that r(l) = 1. 


(90) 
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In any range between two positive values, 0 < pi p g p 2 , the 
improper integral which defines the Gamma function converges uni¬ 
formly. Thus the function is analytic, 
since the integrand is an analytic function 
of p, and hence the proper integrals are 
analytic functions of p. 

Equation (90) shows that the Gamma 
function of n + 1 is a generalization of the 
factorial function. The function T(n + 1) 
is defined for all real values of n greater 
than — 1. And for positive integral values 
of n, the only ones for which n ! was origi¬ 
nally defined, F(n + 1) = n !. 

326. The Gamma Function for Complex 
Values. An argument similar in character to that given in the last 
section shows that the function 

T(z) = f f~ 1 e~ t dt, R(z)>0, (91) 

defines a function of z for all complex values of z with positive real part. 
Here t is real, and we define the power by 

t z = e* log \ with log t real, (92) 

so that if 

z = p + is; | t z ~ l e~ l \ — (93) 



Hence, if p > 0, the absolute convergence of the integral for T(z) of 
equation (91) follows from the convergence of the integral for F(p) of 
equation (86). Also, the convergence is uniform for 0 < pi g p g p 2 , 
so that T(z) is analytic when p > 0. 

We deduce as before that: 


and hence that 


or 


m - 


r(z+ 1) = zT{z), 

T(z + 1) = z(z — 1) * • • (z — k)T(z — k), 
F(z+1) r(z + k) 


(z k — 1) (z *4“ k — 2) 


(94) 

(95) 

(96) 


This last equation may be used to define T (z) for values of z with nega¬ 
tive real part, by taking k so that (z + k) has a positive real part. The 
result will not depend on the value of k used, since equations (94) and 
(95) hold when the real part of z is positive. 
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This procedure defines a function T ( z ), analytic for all finite values of z 
with the exception of zero and the negative integers. For these values 
the function becomes infinite and has a pole of the first order since one 
factor in the denominator of the expression (96) is zero. 

The equation 

2 ! = r(z + 1), (97) 

which holds for positive integral values, is sometimes taken as the 
definition of z ! when z is not a positive integer. In particular, this 
makes 0 ! = 1, the usual convention. 

327. The Beta Function. For positive values of p and q the integral 


f x p ~ l (l -x)*' 1 

Jo 


dx 


(98) 


converges. For, at each limit, one factor of the integrand is finite and 
the other is, at worst, a negative power less than unity of a factor with a 
simple zero. Thus the equation 


B(p,q) = f x p l { 1 — x) q 1 dx, p > 0, q > 0, 

Jo 


(99) 


defines a function of the two positive real variables p and q. It is known 
as the Beta function. 

We may express the Beta function in terms of Gamma functions by 
the following device. We have, on putting t = y 2 , 


r(p) = f t p ~ l e~ l dt = 2 f y 2p ~ l e 

j 0 Jo 


dy. 


( 100 ) 


Now multiply r(p) by I' (q), using this form with the dummy variable y 
replaced by x in the integral for T(q). Thus: 

Y(p)T(q) = 2 f y 2p ~ 1 e~ yi dy 2 f x 29- ^ dx. (101) 

J 0 J 0 

We may consider this product as a repeated integral equal to a double 
integral which is improper but converges absolutely. Hence, by the 
reasoning similar to that of section 244 used in problem 32 of Exercises 
XII, we may show that it equals the corresponding repeated integral in 
polar coordinates, and 

r(p)r(g) = 4 f 2 de f sin 2p_1 0cos i* p+a *' 1 e~* dr. (102) 

J 0 J 0 
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By equation (100), with y replaced by r, we have: 

2 / fSp+ir-ig-ri dr = T (p + ?). 

Jo 

Again, if we put 

sin 2 6 = u, 2 sin 9 cos 6 — du, cos 2 6 — 1 — u, 

we have 

T ' j 

2 P sin 2p-1 0 cos 2 ® - * dd = f u** -1 (1 - u)® -1 du = J3(p,g). 

VO vo 

It follows from equations (102), (103) and (105) that 

r(p)r(g) = r(p + q)B(p,q), 


or: 


B(p,q) = 


r(p)r(g) 

r(p + «) 


(103) 

(104) 

(105) 

(106) 
(107) 


This shows that the function B ( p,q ) is symmetrical in p and q. 

If we put p = q = $ in equation (102), we find on evaluating the right 
member that: 

[r(|)] 2 = v, and r$) = Vt, 


From this and equation (100), with p = we find 

>r. 


/ 


e~** dy = 


(108) 


(109) 


For negative or complex values of the variables, we may use the 
equation (107) to define the Beta function. Thus 


B(z,u>) = 


r(« + w) ’ 


( 110 ) 


for all values of the complex arguments z and w. For complex values 
with positive real parts, the discussion of this section applies with slight 
modification, and the function may be defined by an integral similar to 
that of equation (99). 

828. Product Representations. There are two expressions for the 
Gamma function involving products. These may be derived from the 
equation 


f6-!)W R(z) > o, 


T(«) * lim 


( 111 ) 
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which we proceed to establish. This result is suggested by the relation 

• lim (l - -) = lim [ (1 + hfi] * = e -t , (112) 
»—\ W/ /*—►() L J 

but we require more precise relations to establish the desired result. 
Specifically, we have, for 0 g < g n: 


t 

l--|e » 

n 

1 + - £ 
n 


1 


- - S (l - 4)*' 

n \ n 2 / 


(113) 

(114) 

(115) 


These relations are all equalities for t = 0, and for other values of 
t g n follow since in each case the derivative of the left member is lees 
than that of the right member. The form of the left members is sug¬ 
gested by the Taylor's expansions of the functions on the right. 

For R(z) > 0, we have from equation (91) 


r(z) = f e- l t l ~ x dt = lim f e~ l t?~ x dt, 
J o »—►« «/ o 


(116) 


since the integral converges. Thus equation (111) will follow if we 
show that 


r 

•'o 


dt 


X"(l ~n) n tZ ~ ldt 


approaches zero as n becomes infinite. 

It follows from the relation (113) that 


(l-~Jse- or 


g 1. 


And, from the relations (114) and (115) we may deduce that 

The relations (118) and (119) may be combined to give 

0£l-e t (l--X £-• 

\ n) n 


(118) 


(119) 


( 120 ) 
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As in equation (93), when 

z = p + is; = t p ~' l e~ t J 

and we have for the integrand of equation (117) 


1 — e* ^1 — e H z 1 


t 2 1 

g - c-Hp- 1 or - e-H** 1 . (122) 

n n 


Consequently the absolute value of the integral in the right member of 
equation (117) cannot exceed 


1 /* n 1 /*°° 

- / e~H p+1 dt < - / e~H p+l 
nJ o nJ 0 


dt or -r(p + 2). (123) 

n 


As this approaches zero when n becomes infinite, the relation (111) is 
now established. 

If we put t = nu in the integral of equation (111), we find: 


X (‘ - dt - K 

An integration by parts gives 


f uT 1 (1 - u) n 

Jo 


du. (124) 


f u t -\l-u) n du = 

u z 

1 n r 

- - (1 - tt)" 

+ - 

1 0 

z 

o z Jo 


The integrated part is zero, since R(z) > 0, if n >0. If we repeat this 
process until we come to 

r* 1 1 


we find that 


f ur l (i-u) n 

Jo 


I u z+n 1 du =-j 

r o z + n 


du _ n . "; 2 : 1 -(,27) 

z(z + 1) • • • (z + n — l)(z + n) 


This is in agreement with the equations (110) and (95), since by the 
remark made at the end of section 327 the integral is 

_ r(*)r(» + l) 


B(z,n + 1) 


T(z + n + 1) 


(z + n)(z + n — 1) ■ ■ ■ (z + l)z 
From equations (111), (124) and (127) we find 

. . n ! 7i z 

W r(z) * li m — ——------• 

| »_*» z(z + 1) ■ ■ ■ (z + n) 


(129) 
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This expression was known to Euler and was used by Gauss as the funda¬ 
mental definition of the Gamma function. 

The reciprocal of the fraction in equation (129) is 

K 1+ 0( 1+ i) 

= ^ (l + 0 (l + |) • • • (l + j) (130) 

where 

On = 1 + “+- + ••* 4-log n (131) 

l 6 n 

By equation (63), 

lim On — y, and lim e QnZ = e yz . (132) 

n-*-cc n—► oo 

As the terms multiplying the last may be regarded as the nth partial 
product of an infinite product, we have: 

= e yz z n (l +-)e n . (133) 

T(z) n=i\ n) 


This form is due to Weierstrass, and was used by him as the starting point 
of the theory of T(z). 

Let us consider the logarithm of the typical term of the product, 


Since 



z 

n 


ha 



(134) 


1 

z + n 


1 

n 


— 2 

n(z + n) 



if n ^ \2z\ f 


(135) 


the series of integrands converges uniformly in any finite region not 
including any of the negative integers. Thus, on choosing branches of 
the logarithmic fund ion as in section 285, we see that the integrated 
series converges uniformly in any such region. We may include any 
one of the negative integers without disturbing the uniform convergence, 
if we omit the corresponding factor from the product. Thus the func¬ 
tion defined by the right member of equation (133) is analytic for all 
finite values of z. It is distinct from zero if z is not zero or a negative 
integer. Consequently its reciprocal, the Gamma function as defined 
by this relation, is analytic at all points except zero and the negative 
integers. The derivation only proves directly that the definition of T(z) 
by equation (133), which is equivalent to equation (129), agrees with 
that previously given by equation (91) for R(z) > 0. However, both 
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3 function defined by combining equation (96) with (91), and that 
Bned by equation (133) are analytic for all finite values except zero 
d the negative integers. Hence the difference of the two functions is 
alytic except, perhaps, for zero and the negative integral values. And, 
ce this difference is zero for all z with R(z) > 0, it must be zero 
•oughout its region of analyticity, and the two definitions agree for all 
lues of z. 

If we replace z by — z in equation (133), we find: 


ft' (l + -)e--»= -z 2 ft (l-^Y 

»- -oo \ n / n-i \ nr/ 


z)T(-z) »-iV »v K J 

.t, by section 285, 

sin vz = irz II' ^1 — 0 e ” * ** II ^1 — ^ • (137) 

jomparison of these expressions shows that 

= 1 _ = 1 /I oos 

x r(z)(-z)r(-z) r(z)r(i-z)’ 1 ' 

equation (94), which holds for all values of z, and hence when z is 
laced by — z. Thus we have, finally, 

T(z)r(l - z) = — (139) 

sin irz 

129. Stirling's Formula for Complex Values. The Euler-Maclaurin 
n formula, as given by equations (45) and (46) holds even if the 
iction/(x) is a complex function of a real variable as in section 119. 
>m equation (129), log T(z) is the limit of 


L(z,m) * z log m + ]£ log k — 2- log (z + fc). (140) 
£-1 £-0 

I we put n = 2 in equation (68), replace the remainder by its value 
m equation (69), and insert 1/6 for B 2 in accordance with equation 
!), we may write the result: 

log k m m ,log m — m + \ log m + 1+ — l) 

+ (141) 



Am. 829] STIRLING’S FORMULA FOR COMPLEX VALUES 
For/(x) <=> log (2 + x), an analogous relation is: 

m 

22 log (2 + k) = (2 + m) log (2 + m) — 2 log 2 — m 

+ £ log (2 + m) + \ log 2 + jx(~~ --) 

12 \2 + m 2 / 
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+ 


/\TY 

”0 


p 2 (s) 

(z + x)' 


dx. (142) 


It follows from the last three equations that: 

L(z,m) = - (2 + m + |) log ^1 + + (2 - log 2 

, K _1 (__1 _ i \_ C m Pz ( x ) 

+ m 12 \2 + m z) J 0 


(2 + x)‘ 


: dx, (143) 


where K m is given by 


and 




X 2 dX> 


lim K m = K = log V 2w, 


(144) 


by equations (141), (70), and (79). For z fixed, not a negative real 
number or zero, we may let m become infinite. The integral in equa¬ 
tion (143) will converge, since P 2 (x) is bounded, and the integrand is 
ultimately dominated by A/x 2 ) for a suitable value of A. Thus we find: 

l0gT(2) - - • ^ • 1 C P 2(Z) 


-»+(,- i) log * + x + -L-f^U. (145) 


If the expansion of equation (142) were carried out to more terms, we 
should find: 


log r(2) = -2 + (z - I) log 2 + K + £ 


B, 


2 r 


+ Rn 


rti 2r(2r - 1) 2 2r ~ 1 1 

(146) 

where, by analogy with equation (46), 

P 2 „(x)(2n - 1) ! 


Rn — f 
0 


(2 + X) 


2» 


dx. 


(147) 


Throughout this section, the branch of the logarithms to be used is 
that determined by taking the negative real axis as a cut, and the values 
real for positive real values. The expansion just obtained is valid for 
any fixed n, and any fixed 2 not on the cut. It is also an asymptotic 
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expansion if z becomes infinite in certain restricted ways, for example if 
z remains outside a sector including the negative real axis. This will 
follow after we prove that, if 


z = re® = r cos 0 + ir sin 0, — tt + 5 < 0 < ir — 8, (148) 

the remainder term has a numerical value less than csc 2n (6/2) times that 
of the last term retained. 

We begin by showing that 

|« + x| ^ sin - (|z| + x). (149) 

Z 

Since 

(r — x) 2 ^ 0; (r + x) 2 ^ 4 rx. 


But |#| < 7r 


— 8 implies 


1 . o 


8 

sm - 
1 2 

< 

cos - 
! 2 


so that 


0 8 

— 4 rx sin 2 - *£ — (r + x) 2 cos 2 - » (150) 

Z Z 

Consequently, 

0 8 

r 2 + x 2 + 2 rx cos 6 — (r + x) 2 — 4 rx sin 2 - S (r + x) 2 sin 2 - • (151) 

2 2 

That is, 

\z + x| 2 ^ (|z| + x) 2 sin 2 |> (152) 

z 


and the inequality (149) follows by taking the positive square root. 

It follows by the argument used to show that the remainder term is 
numerically less than the last term retained when z is real and positive 
that 



|P a .(a01(2n - 1) ! 
(1*1 + *) 2n 


dx < 


IJhnl 

2n(2n - 1) 


1 


1*1 


2n—1 * 


(153) 


But by equation (147) and the relation (149) we have: 

|P*»(x)|(2n - 1) ! 


\R»\ £ 


f 


12 + X\ 


2 n 


dx 


g CSC 2 ” 


5 r a 

iJ a 


P 2n (x)(2n - 1) ! 


(1*1 + x) 


2 n 


dx. 


(154) 


A comparison of the last two relations shows the relation of the remainder 
to the last term retained stated above, and the asymptotic character of 
the expansion (146) then follows. 
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330. Integral Representations of Euler’s Constant. Certain impor¬ 
tant definite integrals are simply related to Euler’s constant, which we 
have defined by: 


y = lim (1 + \ \ + -b - - log nY 

n-foo \ 2 6 n ) 

We begin with: 


1 + t + r -b C _1 = 


1 - t n 
1 - t 


On integrating this from 0 to 1 we find: 


11 1 r l 1 

1 4- _ ~b ~ + * * • “b ~ I — 
0 0 n Jo 1 


1 1 - t n 


t 


dt. 


2 3 

Let us replace the dummy variable t by a new variable y, where 

V 


t = 1 


(155) 


(156) 


(157) 


(158) 


Then 


»»> 


Since 


y 


(160) 


-log n = - J 
it follows from equations (157) and (159) that 7 is the limit of 

-Xl'-O-Oli-X'O-rT- < l6l > 

The relation ( 112 ) suggests that the limit of the last expression is the 
same as that of 

dy 


f\i f. 

J 0 y 


y 


(162) 


To verify this conjecture, we note that for 0 £ y ^ n 
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as A consequence of the relation (120). Consequently, the final mem¬ 
ber of equation (161) exceeds the expression (162) by a positive quan¬ 
tity which does not exceed 



s 1 
n y n 



ye"* dy 


or 


r(2) _ 1 
» « 


(164) 


As this has a limit zero, when n —> «>, the number y is the limit of the 
expression (162), and 



(165) 


This expresses Euler’s constant in terms of improper integrals. 

The first integral may be computed from the rapidly convergent series 
which results by replacing e -v by its power series expansion and inte¬ 
grating termwise. The second integral may then be found by combining 
this with the value of y, equation (66), determined by the method of 
section 323. The results are: 


and 




0.79660 • • • 



0.21938 


(166) 


We may obtain another expression for y in terms of an integral involv¬ 
ing trigonometric functions, by the method of residues of section 278. 
The function (1 — e~ z )/z has a removable singularity at the origin, but 
otherwise is analytic for all finite values. Hence by integrating around 
a quadrant of a circle of radius unity in the first quadrant, we find: 




o 


dz 


•'o y 


o, (167) 


where Qi is the circular arc. Similarly, by using a quadrant of a circle 
with arc Q%, in the fourth quadrant, we find: 


/\l+ / (1- 




0, (168) 


where we have put z = — iy on the y-axis. 

Again, the function e~*Jz is analytic for all finite values except zero, 
so that its integral around a quarter of a ring bounded by the are Q u 
a large quadrant Q{ in the first quadrant, and portions of the *- and y- 
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axes will be zero. The reasoning of section 281 shows that the integral 
around the large quadrant Q[ approaches zero as its radius becomes 
infinite, and hence: 



(169) 


A similar quarter ring in the fourth quadrant may be used to give 



(170) 


where we have again put z = —iy on the y-axis. 

If we add the members of equations (167) and (170), and subtract 
those of equations (168) and (169), we find: 

J 1 ' 1 dx C™ dx r l dy 

(1 - e~ x ) -2 / e~ x -H / (-2 + e" + e~' v ) — 

o x Ji x J o y 

+ f (e' v + e~*) ^ + / f ~ / f ( 171 > 

Ji y Jq , z Jq, z 

But, by putting z = e*® in each case, we find 

(mi 

z ”(2% z 2 

This shows that the last two terms of equation (171) cancel, and the 
equation may be written: 


/a 


X 


dx 


f 1 (1 - cos y) - - r cos 1/ — • (173) 

Jo y J\ y 


From this and equation (165) we obtain 

dy 


f (1 - cos y) — - f 

J 0 y J i 


dy 

cos y — > 


(174) 


the expression for y in terms of integrals of trigonometric functions which 
we were seeking. 

331. Some Non-elementary Integrals. Consider the exponential 
integral 

r m e~ l 

EI(x) = J yd<, x>0. ( 175 ) 
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We find by successive integration by parts that 


BI(z) 


Ti-I 

Lx X 2 


s 3 


+ (- 1 ) 


n nil 
n _ 

x n+1 _ 


+ Rn+l, (176) 


where 


= (~l) n+1 (w + 1) ! J e~H~ n ~ 


As x is positive, the integral is increased by replacing the power of t by 
the corresponding power of x, so that 

\Rn+i\ S (» + 1) le-*x~ n - 2 . (178) 

Thus the remainder term is numerically less than the term following the 
last term used in the expansion (176). For sufficiently large values of x, 
one of the early terms will be small, and the series may be used to com¬ 
pute the integral. It is only an asymptotic series, however, since 
although for fixed n and increasing x the remainder approaches zero, for 
fixed x and increasing n the series diverges. This follows from the fact 
that the ratio of consecutive terms is numerically n/x , which becomes 
infinite with n. 

An expansion of El (x), convergent for all values of x, may be obtained 
by using a result based on equation (165). We have: 


/ CO 


' 7 + 




J r* 1 dt r 1 , _, v dt 

. r 7 + X (1_ ' ) 'i~ y 

r _ dt 

(1 “ e ') — - log x - y. 

* 

If the first integral is expanded in a power series, we find: 
EI(X) - + + 


The logarithmic integral, 


i 


,» 0 g x < 1, 


may be transformed into the exponential integral, by t — e “, 


- f e~ u - 

** -logx 


■EH -log x). 
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We may treat the cosine integral, 


cm - f 


cos t - 


. dt 

-, 

t 


(184) 


in a manner similar to that used for the exponential integral. The 
asymptotic formula for large values of x is: 


~ T „ N sin x , cos x . sm x , cos x 
C7(x) -H 2 —h 2 ! —3 3 ! —j— 

X X 1 X 6 X 4 

By using equation (174) we find that: 

dt 

(1 — cos t) -log x — y 

o t 

= -7 - log X + 


2*2! 4*4! 


+ 


(185) 

(186) 
(187) 


which may be used to calculate the integral for all values of x. 
For the sine integral 

dt 


81 { 2 )=f Sin tj 


(188) 


we may use integration by parts to obtain the asymptotic expansion: 

. (189) 


cos x sin x . cos x „ . sm x , 

SI(x) =-+ — 2 - “ 2 ! — 3 - - 3 !— + 

X X * x 6 x 4 


To obtain an expansion convergent for all values of x, we recall equa¬ 
tion ( 221 ) of section 281, namely, 

dt 


J r* 00 . dt t r 

sin < — = • 

o t 2 


(190) 


It follows from this that 

SI (x) = f 

i / 0 


00 . dt 
sm t — 
t 


r x . dt 

— I smt— 
J 0 t 


3 

7T t X X 

= 2 “ X + 3-3! ~~ 5- 5 ! 


+ 


Similar methods apply to the probability integral, 




*** * 3 + 5-2 ! 7-3 ! + 


(191) 


(192) 
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the Fresnel sine integral 


r 


sin x 2 dx 


rll 


7 - 3 ! 11-5 ! 


and the Fresnel cosine integral 


f 


COS 


x 2 dx — x 


5-2! 9-4! 


(193) 


(194) 


These power series converge for all values of x. 

The integrals from x to « may be obtained from those from 0 to * 
by using the evaluation: 

\/ 7T 


/ 

V0 


e"* 2 dx = 


(195) 


foimd in equation (109), and the two derived from it in problem 47 of 
Exercises XIII: 


sin x 2 dx = —j—• and f cos x 2 dx 

o 4 J 0 


4 


(196) 


For the integrals from ito the asymptotic formulas: 




cos x 2 dx = 


+ _L 

6 \2x 2 2 x 3 + 2V 

35 \ 

2 4 x 7 + 7 ’ 

(197) 

cos x 2 sin x 2 3 cos x 2 

3 • 5 sin x 2 , 


2x 2 2 x 3 2 3 x® 

2V +‘ 

} 

(198) 

sin x 2 cos x 2 3 sin x 2 

3 • 5 cos x 2 


2x 2 2 x 3 4 2 3 x 6 

1 

1 

> 

(199) 


may be found by integrating by parts, in each case taking as the factor 
to be integrated xe - ®*, x sin x 2 , or x cos x 2 . For sufficiently large values 
of x, these may be used to compute the integrals from x to », and the 
values of the integrals from 0 to x may then be found for these large 
values by making use of equations (195) and (196). 


1. Show that 



x’V 1 ’** dx 


EXERCISES XVI 



if m > — 1 , p > 0, q > 0. 


Change tile variable from x to t « px q . 
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2. Show that 


I 


x n Gog x) m dx = .^ ^ » if m> - 1 , n> - 1 . 

o (n + l ) m+1 


Hint: Change the variable from x to t = — (n + 1 ) log x. 
3. Let 


H p = £ = x 


1 , . ^ (- D *- 1 

“l & " p jf?o (2k + I)? and h ~ &\ k* 


where p > 1 and need not be integral. Show that s p = (1 — 2~ P )H P and 
t p = (1 — 2“ p+ 1 )ff p . When p is not an even integer, H p may be computed by 
equation (61), but if p is an even integer the value is determined exactly by 
equation (5) as 

2 2n - 1 7r 2w (-l) n - 1 £ 2 n 


Hence, in particular, 


H 2n = 


H 2 = 


s 2 


( 2 n) ! 


— > to 3 = -- 

8 2 12 


4 . Show that 


I 


1 ( -log x)P 
1 - a: 


« J_ 

k” +1 


dx= r(p+l) x T^T if P>0- 


For the calculation of the sum, or exact evaluation when p is an odd integer, see 
problem 3. Hint: Expand 1 /(I — x) in a power series and integrate termwise. 
The process is valid by section 247. Since for 0 < x < 1, the partial sum 

n i — x n + l 2 

T 2 x l =-< -- y the partial sums are dominated by twice the 

i?o 1 — x 1 - x 

original integrand. 

6 . Show that 



(-logs)** 
l + x 


dx = T(m + 1 ) 


00 



(- 1)*- 1 
k m + l ' 


if m> — 1 . 


For the calculation of the sum, or exact evaluation when m is an odd integer, see 
problem 3. Hint: Proceed as in problem 4. 

6 . Show that 





log x 
1 — x 


dx = 


ir 


2 


6 ’ 


Hint: Integrate by parts, and use problem 4. 
7, Show that 




log x 
+ 


w 2 
12 ' 


Hint: Integrate by parts, and use problem 5. 
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8 . Verify that 


and deduce that 


and hence 


t coth t — t~ 


2 1 


7 = Z 

l „»o 


(»)" 

nt ’ 


1 * 2 ik 
coth z = - + L Bik 77777 2 1 2 * -1 ’ 
2 (2k) I 


1 , ^ n (-l) fc 2 2fc 

cot z = - + E 5 2 * - 77777 - 
« Jfc«l (2A*) I 


By problem 3, the last result is in accord with that of problem 51, Exercises 

XIII. 

9. Prove the identity tanh z — 2 coth 2 z — coth 2 , and deduce that 


00 (om _ 1)9^ 

tanh ? = E — 77777 — B 2 * 2 2 ‘ _1 - 
* = 1 ( 2 A) ! 


Similarly deduce that 


" (2-* - 1)2»<—1)*-> . 
tan *-£,- Wi - B “ 


either from the identity tan z = — 2 cot 22 + cot 2 , or from the result for tanh z. 
Hint: Use problem 8. 

z 

10. Prove the identity cseh z = —coth z + coth - > and from this and prob- 
1 00 (2 - 2 2k ) 

lem 8 deduce that csch z = - + £ -.; Also, either from this 

Z {2k) ! 

2 

or the identity esc z « — cot 2 + cot ~ > deduce that 


1 00 
CSC z = - + 21 

2 £ = 1 


(2 - 2 2 i )(-l)* 
(2k) ! 


K ik £- 


11. Verify the identity 2t sech l = 4te u /(e*‘ — 1) — 4te l /'(e 4t — 1 ). By equa¬ 
tion (39), the right member is 

E (find) - *.(i)](40», or E -25 2 * +1 (l)(4<) 5i+1 

«** 1 k**Q 


by section 319. Hence 

sech 2 « £ 

k~0 

and 

sec « « £ 

12. Operational notation . Let D denote the operation of differentiation, and 
A denote the operation of increasing z by a and taking a difference, as in section 

A 
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93. Then 1 + A — e aD is an abbreviation for Taylor’s series, since when e aD is 
expanded in a power series, and we operate on F with each side: 

(1 + A )F = F(x) + F(x + a) - Fix) = F(x + a), 
and 


( 


1 + aD + ~ -f 
21 


> 


a?F"(x) 

F(x) + aF' (x) + + 

A I 


The abbreviation for the Euler-Maclaurin sum formula may be found by formal 
transformations of 1 + A = e aD into aD = A aD He aD - 1 ). If we expand the 

right member into £ AB n -by equation (37), and operate with each side 

n=0 11 I 

on F — f f(t) dt t we find: 

Jo 


00 a n n 

afix) = aDF = £ AB n —- U n F = / fit) <U-- n [/(x + a) - fix)] 
n= o n ! J x 2 


+ £ ^[r*- i \x + a)-r 

r =i (2 r) ! 


With a = 1 and x — k , and the infinite series replaced by a finite sum and a 
remainder term, this is essentially equation (44), from which we derived the 
Euler-Maclaurin sum formula. 

13. While the operational procedure of problem 12 proves nothing, it fre¬ 
quently suggests expansions which may be shown to be convergent or asympto¬ 
tic by other means. For example, an expansion in terms of differences useful for 
numerical integration is suggested by transforming e aD = 1 + A into 

X x-f-a 

f{i) dt - a(l + A/2 — A 2 /12 + 

A 3 /24 — •••)/• Show that, if all differences after the fourth are zero, the 
result obtained by using this for x to x + a and x + a to x + 2a is the same as 
that found by Simpson's rule, section 145, for the single interval from x to 
x + 2a. Hint: For x + a to x + 2 a we operate with. (1 + A), and the first 
result is o(2 + A)(l + A/2 — A 2 /12 + A 3 /24)/. The result from Simpson's 
rule is a/3 [1 + 4(1 + A) + (1 + A) 2 ]/. These agree since A 4 / = 0. 

14. Show that the value of y in equation (66) may be found from equation 
(65) with m ~ 10 and the terms in Bo and B 4 , since the term in B 6 , and hence the 
remainder is less than 5 • 10~ 9 . 

16. The percentage error made by replacing m ! by Stirling’s approximation, 
V2 ?ris less than 0.1 per cent if m exceeds 100, less than 1 per cent if 
m exceeds 10, and less than 10 per cent if m exceeds 1. 

16. Show that J* (x - a) m {b - x) n dx = (6 - a)"*+" + 1 B(m + 1 ,n + 1 ), if 

b > a and m > — 1, n > —1. Hint: Replace x by t , where x — a = (6 — a)$. 
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17. Show that 

r^ (P '- xTdx -E^ B ( n+ 1 > ?±i) 

Jo q \ q / 

if p > 0, q > 0, m > —1 and n > — 1 . Hint: Replace x by t where x 9 * p 9 L 

18. Show that 

r V . m „ ^ 1 /m + 1 n + l\ 

sm m x cos n x dx = - B \ -»-J 

2 V 2 2 / 

if m > — 1, n > — 1 . Hint: Change the variable to t « sin 2 x. 

19. As a special case of problem 17 or 18, we have: 


J r 1 x m dx rl . ri m)Ji i /m + i i\ ^ , 

—= I sin** t dt = I cos w £ dt = ~ B (-> - j , m > — 1. 

0 Vl - x 2 Jo Jo 2 \ 2 2/ 

The right member is |[r( {w + 1} / 2 )T (1 /2)] /[T(m /2 + 1 )], and for m an even 


integer, 2n, is 


1 • 3 • 5 • • • (2n - 1) 7T 


2 * 4 • 6 • • • (2n) 
2 * 4 • 6 . *. (2n) 


; while for m an odd integer, 2n + 1, it is 


3'8 - 7 < - (2vi + 1) 

20. Wofiis’s product for t. Show that the integral of problem 19 decreases as 
m increases through integral values, so that 


2 * 4 * 6 • • • (2n) ^ 1 * 3 - 5 • • • (2n - 1) w ^ 2 • 4 • 6 * • • (2n - 2) 

3 • 5 • 7 • * • (2n + 1 ) < 2 * 4 • 6 * * • (2in) 2 < 3 • 5 • 7 • * - ( 2 n - 1 ) * 


Deduce from this that 


7T m 2 • 2 • 4 • 4 • 6 • 6 
2 ~ 1 • 3 • 3 • 5 ■ 5 • 7 


where the partial products are alternately in excess and defect. This is essen¬ 
tially equation (73). This derivation may be made “ elementary ” since the 
integrals of problem 19 may be evaluated without using the theory of the Gamma 
function, for example by integrating by parts. 


21. Show that 


r 


dx 


1 


< 


aS+J, t 


m + 


-O' 


q q 

Replace the variable x by t 


(1 + PX*)* 

p> 0,q> 0,m> — 1 and k > (m -f 1 )/q. Hint, 
when (1 + px*)~ l = 1 — t. 

22. It was proved by contour integration in problem 40 of Exercises XIII that 

$r~p 


X 


o l + * 


■dx ■ 


smpr 


, if 0 < p < 1. Verify this result by using Gamma functions. 


Hint: By problem 21 the integral equals J3(l - p,p) 
by equation (139). 


r(i - p)r(p) 


T 

sin p*r 
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28. In n dimensions, let V„ be the volume for which Xi Si 0 , xt g a. 

♦-1 

Then I x?'xf' • ■ • dV„ = I(n,a), where vu > — 1 , equals 
Jv « 

a^i+n nr(w t - + 1) f 

T(£mi + n + 1 ) 


with t from 1 to n in the sums and product. Hint: For n = 1, 
1(1, o) = X m 'dx and a m > +1 [r(m, + l)]/lT(»t + 2)] = a"> +1 /(mi + 1). 

Now use mathematical induction. l(n,a) = J dx n I(n - 1, a - x„) « 

l(n- 1,1) f x%n( a - x n y dx n = a m »+'+'B(m n + 1, J + 1 )I(n - 1,1) = 
•/o 


a m n +j+i [r(m n -f l)r(J + l)]/[r(m n + J + 2 )]/(n — 1 , 1 ), where throughout 

n—1 

J = 2* m ? + n — 1 . Thus m n + J + 1 = 2Z m » + and the calculation 
j*-i 

shows the result true for n if true for n — 1 . 

24. If V n is defined by Zi ^ 0, 21 J ^ l,andm<> —1, 

*-i W 



The integrals of this problem are known as Dirichlet’s integrate. In three dimen¬ 
sions they enable us to compute the volume, first and second moments, and 
hence centers of gravity and moments of inertia of octants of solids bounded by 


“*“(«) + (O' + («)’ 


1 , e.g., an ellipsoid. Similarly in two dimen¬ 


sions for the areas and moments of quadrants of areas bounded by 



1 , e.g., an ellipse. Hint: Reduce this integral to that of prob¬ 


lem 23 by the change of variable (z»/a*) p *‘ * Ui . 

25. If F(u) is continuous, F„ is the volume of problem 23, and m*> — 1, 

*‘> r ' ir ' • • ■ *- 
Hint: Approximate the multiple integral by a single sum, using as element of 
volume that between Tt; = u and = o + Am. This element is Ati times 
an intermediate value of dl(n,u) jdu, where 7(n,u) is the integral of problem 23 
with »in place of a. 
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26. If F(u) is continuous, V„ is the volume of problem 24, and > — 1 , then 
■X^dVn - 


Jy Lt*i\a»/ _ 


(X w t + n) n 

r„"»s+l 
-— ] 
- Pi 

XT)] 

r 

X 

mi + I s ) 
. Pi ) 

1+1_ 



n 1 du. 


Hint: Use the result of problem 24, with a x replaced by a t u 7 and then proceed 
as in the preceding problem. 

27. If U denotes the volume of a “ sphere ” in n dimensions, made up of points 

l ^(n-f-U/2 


R n 


such that S R 2 , show that f dV n = r . 

JuVRt-Xxi r[(n+l)/ 2 ] 

Hint: The integral is 2 n times the part with positive coordinates. By problem 
26 this is reducible to that found in problem 17. 

28. The “ volume ” of an n-dimensional “ sphere ” of radius R is equal to 
T n ' 2 R n /T[(n/2) + 1 ] and the “ surface ” is ut^R"” 1 /F[(n/2) +1]. For n « 
2, 3, 4 the “ volumes” are ttR 2 , %ttR* and §7rft 4 , while the “surfaces” are 
2 irR, 4:wR 2 and 2 ? r 2 R z . Hint: Use problem 24, and the hint to problem 27, 
for the “ volume.” The “ surface ” is the derivative of the “ volume ” with 
respect to R. 

+ x~« 


29. Show that 


/' 


0< o< 1 . Hint: f -— 

Jo (1 + 

problem 21 to evaluate 


o (i + xy-p-i 
- p dx 


dx = B (1 - /;, I-?) if 0 < p < 1, 




u « da 1 

-if x = - • Now use 


30. The function 


ion f 

Jo 


x y- P -<j 

J "°° u ~ q du 

o (1 + u) 2 -*~«' 

30 

x q e~ x * dx , for q > - 1 and z complex is an analytic 


function of z for all z with positive real part, by the argument of section 303. 

X oo 

x q e~* z dx = T{q + 1 )/zJ t¥ \ If z = a + bi ® re**, with a > 0, 
—tt /2 < 0 < ir/ 2 , we have: 

X 


e~~ ax cos bx x q dx = ■ - ■ - - --■ 7 --— cos (q + 1)0 and 




X‘ 


gfo x q fa 


HlXXsin (g + 1)0. 

x q-rl 


31, If R(p) > R(r), and q > — 1, the function whose Laplace transform is 
l/(p *. r)«+* is x*f*/T(q + 1). For 9 an integer this agrees with problem 60 
of Sxerciees XIV. Hint: Put 2 = p — r in the integral of problem 30. 
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J f CO /»QO 

dx I dy cos bx y p ~ l e~ xv dy, 

o Jo 

that if b > 0 and 0 < p < 1, f °° - Hint: 

Jo x p T(p) 2 cos (px/2) 


show that if b > 0 and 0 < p < 1, / —- dx 

Jo x p 

r co 

yp-l e -xy dy _ 


obtained by putting 


xy * w. For the other order, / cos 6x e~ xv dx = 


& 2 + y‘ 


by section 135, and 


J ^ 00 y p dy b p ~ l P 00 w**- 1 )/* 
o b 2 y 2 2 Jo 1 u 

b*- 1 7T 


du, if b 2 u — y 2 . By problem 22 this is 


* /!-p\ 

V 2 J 


33. Prove that 


n si 

Jo 


sin bx . 
-ax 


r(p) 2 sin (pt/2) 


> if 6 > 0 and 0 < p < 1. 


//inf; Proceed as in problem 32. Here I sin bx e~ xv dx 


J r* oo 

sir 

o 


b- + y~ 


34. Show that 


1 0 * p 2 


J "' 00 sin bx ,_ lri/i x pir 

-dr = 6 P x r(l — p) cos — > 

o * p 2 

if 6 > 0 and 0 < p < L Hint: Use equation (139), and the results of problems 
32 and 33. Or replace q, a, r, 6 by — p, 0, b, x /2 in problem 30. That this 
process is valid follows from the fact that the difference between the integral in a 
and that with a = 0 is dominated by the integral of problem 30 of Exercises XII. 

35. Show that 


cos (bx k ) dx = 


r(T) 

1 (s) “ d I" ,in <te,) * * —i “ (a) ■ 


if &> 0, k> 1. The special case I cos x 2 dx - I sin x 2 dc 

Jo Jo 

agrees with equation (196). Hint: Put u = x k , and use problem 34. 

36. Establish the duplication formula for P(z): 


r(2z) = -y= 2 2 *~ 1 r(z)n 

V X 


H) 


(Legendre.) Hint: 


J r **/2 /** . 

sin*xcos n xdx - 2~ l ~ w I sin n w du, if u ~ 2x, or 2~ n I sin" t* au. 
A 4/0 «/o 
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Evaluate the first and last integral by problem 18, with n «■ 2z — 1, to get 


rwrw 

r<2s) 


r( ^L, 

(‘ + 0 


In the proof z is real, but theresult extends to other z by analytic continuation. 

87 . Show that if z is not a negative integer, 


nm i \n z + n/ 


Hence, in particular, if z is a positive integer, k , 


r^fc) i i i 


Hint: Use equation (133), take logarithms and differentiate. 

88. If R(z) > 0, the kth derivative of r(z) is given by 

^rr = r l‘~ l e~* (log z) k dt. 

dz* J o 


(log z) k dt. 


Bird: Use the uniform convergence, for R(z) > p > 0, and reason from this as 
in section 273. 

89. Prove that 

/2n-l 

~—-dt 


X oo An —1 

:dt 

r^) 


(e 2 * 1 - l ) 2 


Hint: Use problem 4, with —log x = 2 t rt, p = 2n — 1 for the first integral, and 
integrate this by parts for the others. 

J r»» x 2n 

— dx « x 2n 5 2n (—l)"” 1 . Hint: Use the last inte~ 
o sinh 2 a; 

gral of problem 39, with ir£ * x. 

41. Show that ^ . Hint; Replace 

Jo sum x 2n 

l/sinhz by 2/(e* — 1) — 2/(e** — 1), and evaluate by putting 2irt =* * and 
■H m x in the first integral of problem 39. 

42. Show that T(llm)T(2/m) ■ • • r[(m - l)/«] - (2ir)<»-»/*/V^, m a 


. Hint: Replace 


positive integer. Hint: X z k 

*-o 


- ~ - 1 - * ”ff (* - e 2 ** 1 '*). Put* = 1, and 
» - 1 *-1 
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tn-'-'l 

(1 _ e iMim) m (~2ie kTilm ) sin far jm. Then II e*”'"* *= - i~*. 

m-l 1 i ” 1 

Thus m « II (1 - «“*/") = 2 m ~ 1 "ft sin — • 

l m 

Put r(l /m)F( 2 /m) • • • T[(m — 1 ) /m] « P. Then P > 0. Furthermore 

P 2 » II F ( r (~—= II —, by equation (139). Thus 
*-l \m/ \ m ) *-1 . kir 

sm — 
m 

P 2 ** (2 w) m ~ l /m t by the result just proved, and P == (2w) im ~ l)l2 l‘\/m. 

43. Demonstrate that r(z)T(z + 1/m) • • * T[z + (m — l)/m] = 6 ( 2 :) ** 
( 2 x) (tn “ 1 )/ 2 m l/2 “ fnj r(mz). (Gauss.) Hint: By equation (129), 1 /(j(z) is the 
limit of 

mz(mz + 1 ) • • • (mz + mn + m — 1 ) # 

— m _ 1 ; 

n 2 (n !) m w m(n ' fl) 


while F(mz) is the limit of 


(ran)™*(mn) ! 


mz(mz + !)•*• (mz + mn) 


Thus m~ 


r(mz) . 

w * 


is 


the limit of 


(mn — 


(mn) ! (mz + mn + 1 )(mz + mn + 2) • • • (mz + mn + m — 1) 


m-fl 


^(m—D/ 2 ^ 

mz + 2 > ^ 


or 


1 ) ? n 2 A mz + l \A + mz 4- 2 \ A ^ mz -f m - l \ 

wi m *m y mn / \ mn / \ mn / 

When n—> 00 , the factors involving z approach 1 , and G(z) = Qm^'F^z), 
(n !) m rn tnn 


(n I) 1 


with Q = lim 


n—*-oo (mn — 1) 1 n (w4 ~ 1)/2 * 

problem 42. Thus P ~ G ^ — Qm~ l 9 


To evaluate Q, put z — 1/m and use 


and Q = mP. 


For m = 2 the relation of this problem reduces to the duplication formula of 
problem 36. 

44 « Show that the expression of the Beta function in terms of Gamma func¬ 
tions, equation (107), may be proved by inverting the order of integration in 


J f»09 /»« 

e -VyP+Q-l dy I 

0 Jo 

/: 


e -*v x p- 1 dx . Hint: If u = xy , y v J e xv x p 1 dx = 


6 -« u p-i ^ so that in the order given the integral is T(q)T(p), 

Similarly, (1 + x)*+« f " e -< 1+ * dy « T(p + q). Also 

Jo 


s; 


3 ;p- l (l 4 . x)~ p ~ l > dx = B(p,q) 


by problem 21. Thus in the other order the integral is T(p + q)B(p,q). The 
inversion is justified by section 244, since the integrals converge absolutely. 
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generalizations of, 262 (8-12) 

Cantor’s theorem on transcendental 
numbers, 56 (34) 

Cauchy-Goursat theorem, 438 
Cauchy-Riemann differential equations, 
423, 467 (5-7) 

Cauchy’s convergence criterion, 35, 40, 
156, 301, 392 

Cauchy’s integral formula, 441 
Cauchy’s remainder in Taylor’s theorem, 
141 

Cauchy’s residue theorem, 454 
Center of gravity, 288 
Ces&ro sums, 486, 512 (38-41) 

Change of variables, 335, 465 
in an integral, 209, 368, 455 
Characteristic curves, 539, 544 (30, 32) 
Characteristic functions, 242 
Circle of convergence, 430 
Circle of uniform convergence, 430 
Clairaut’s differential equation, 541 (12), 
545 (31) 

Closed intervals, 11, 20 
Closed regions, 47 
Closed sets, 16, 251, 262 (12) 

Closure, 252 



688 


INDEX 


Commutative law, 4 
Comparison test, 302 
Complete integrals, 538, 545 (31, 34) 
Complex function of a real variable, 186, 
211 

Complex numbers, 151 
Complex variables, 151, 156, 422 
functions of, 157, 422, 444, 464 
Component, 152 

Composite functions, 48, 100, 173, 333, 
465 

Composition, 498 (*) 

Conditional convergence, 316 
Conformal transformations, 425 
Conjugate complex numbers, 153, 184 
Connected region, 337 
Content, 242, 244, 358, 367 
Continuity, 38, 40, 42 
Continuous functions, 43, 47, 158, 396 
integration of, 195 
Continuous limiting function, 396 
Convergence, 273, 276, 298, 319, 320 
Convergence in the mean, 407, 490 
Convolution, 498, 503, 514 (45) 

Cosine integral, 218, 573 
Covering theorem, 14, 16, 19, 21 
Cross-ratio, 190 (22) 

Cubic equation, 191 (27) 

Curvature, 295 (11-13), 541 (8) 
Curvilinear coordinates, 354 (29-34), 387 
(9, 10), 467 (6) 

Cuts in a number system, 5, 9 

Darboux’s condition of integrability, 242 
Decreasing functions, 37, 115, 256 
Decreasing variables, 37 
Dedekind's theorem, 10 
Definite integrals, 194, 201, 546, 571 
and Bernoulli numbers, 575 (4-7), 582 
(39-41) 

and Gamma functions, 546, 574 (1, 2, 
4-7), 577 (16-19, 21-30, 32-35) 
and residues, 456, 471 (38-47) 
and special devices, 420 (29-37), 511 
(32), 515 (50-52) 

De Moivre’s theorem, 189 (9, 10) 
Derivatives, 65, 97,118, 331 
higher, 109, 187, 334 
Determinant^ 146 (6), 353 (19) 
Jacobian, ## Jacobian determinants 

V* 


Wronskian, 146 (7-9), 238 (46), 542 
(13-16) 

Diameter of an arc, 279 
Difference equations, 193 (41-44) 
Differences, finite, 144, 193 (42), 232, 576 
(12, 13) 

Differentiable functions, 109, 332 
Differential, 107, 331, 379 
expression, exact, 379 
total, 331, 335, 381 
Differential equations, 516 
analytic solutions of, 516, 520 
Bessel, 468 (10) 

Cauchy-Riemann, 423, 467 (5-7) 
Clairaut, 541 (12), 545 (31) 
continuous solutions of, 520 
differentiable solutions of, 523 
Hamilton-Jacobi, 545 (32) 
homogeneous, 192 (34), 540 (5) 
hypergeometric, 468 (12) 

Laplace, 466 (1, 4), 474 (53), 512 (37) 
Legendre, 468 (11) 

linear, see Linear differential equations 
partial, see Partial differential equa¬ 
tions 

Riccati, 544 (27, 28) 
separable, 210, 540 (3, 4) 
singular solutions of, 541 (9-12), 544 
(29) 

systems of, 518, 543 (24, 25) 
unique solutions of, 516, 521 
Differentiation, 97, 172, 331 
of integrals, 206, 449 
of series, 405, 431 
Direction cosines, 371, 373 
Directional derivative, 351 (10, 11) 
Dirichlet's definite integrals, 579 (23-28) 
Distributive law, 4 
Divergence, 273, 276, 299, 319, 320 
Domains, 363 

Dominated functions, 400, 404, 469 (17) 
Double integrals, 356 
Duhamel sums, 266, 291, 389 (28) 
Dummy indices and variables, 203 
Duplication formula for the Gamma 
function, 581 (36) 

6, 66, 70 

Elementary functions, 57, 106, 174, 434 
Elliot's definite integrals, 420 (29) 
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Elliptic integrals, 218 
of the first kind, 227 
Enumerability, 5, 22 (12, 13), 55 (33), 
249, 256, 262 (12) 

Envelopes of curves, 525, 541 (7-9) 
Envelopes of surfaces, 535, 539 
Equi-continuity, 412, 415 
Essential singularity, 452 
Euler-Maclaurm sum formula, 554, 576 
( 12 ) 

Euler’s constant, 326 (9-11), 556, 569 
Euler’s expression for the Gamma func¬ 
tion, 565 

Euler’s theorem on homogeneous func¬ 
tions, 352 (12, 13) 

Even functions, 233 (1), 493 
Evolute, 295 (12, 15, 22, 23), 541 (7) 
Exact differential expressions, 379 
Exponential function, 57, 59, 61, 73, 159 
as a limit, 93 (3, 5) 
differentiation of the, 101, 173 
Fourier series for the, 509 (21) 
not algebraic, 144 
order of the, 142 

Taylor’s expansion for the, 128, 148 
(26) 

Exponential integral, 218, 238 (45), 571 

Factor theorem for polynomials, 178 
Factorial function, 557, 560 
Faltung, 498 (*) 

Fear’s divergent Fourier series, 513 (42, 
43) 

Fej^r’s theorem on Fourier series, 486, 
510 (27, 30) 

Finite differences, 144, 193 (42), 232, 576 
(12, 13) 

Force, 288 

Fourier coefficients, 477, 506 (3, 4) 
Fourier integrals, 493, 496 
Fourier series, 475, 483, 490 
differentiation of, 509 (19, 20) 
integration of, 492, 507 (16) 
uniform convergence of, 485 
Fourier transforms, 497, 501, 514 (44, 46, 
47) 

Fractions, partial, 181, 186 
Fresners integrals, 218, 574 
Frullani's definite integrals, 421 (35) 
Functional dependence and Jacobians, 344 


Functional equations, 95 (31-33) 
Functions, 24, 38, 46, 157, 422, 464 
algebraic, 143 

analytic, 444, 464, 474 (52-54) 
Bernoulli periodic, 546 
Bessel, 468 (10), 515 (52) 

Beta, 561 

bounded, 41, 194, 239 
bracket, 54 (20) 
characteristic, 242 

complex, see Complex function and 
Complex variables 
composite, 48, 100, 173, 333, 465 
continuous, 43, 47, 158, 195, 396 
decreasing, 37, 115, 256 
differentiable, 109, 332 
dominated, 400, 404, 469 (17) 
elementary, 57, 106, 174, 434 
even, 233 (1), 493 

exponential, see- Exponential function 
factorial, 557, 560 
Gamma, see Gamma function 
Gudermannian, 191 (28) 
homogeneous, 352 (12, 13) 
hyperbolic, see Hyperbolic functions 
implicit, 50, 338, 540 (1, 2) 
increasing, 36, 114, 256 
integrable, 195, 239, 358 
inverse, see Inverse functions 
limiting, 390 

logarithmic, see Logarithmic function 
monotonic, 36, 115, 255 
non-differentiable, 146 (10) 
odd, 233 (2), 493 

of bounded variation, 256, 260, 263 
(20, 21), 282 

of complex variables, see Complex 
variables 

periodic, 233 (6, 7), 475 
power, 57, 64, 170 
rational, see Rational functions 
sequences of, 390 
signum, 94 (22) 

trigonometric, see Trigonometric func¬ 
tions 

variation of, 257 
Weierstr&ss #>, 227, 278 
Fundamental theorem of algebra, 175, 
471 (37) 

Fundamental theorem of the calculus, 207 
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Gamma function, 546, 559 
as a limit, 564 
definite integrals related to the, 546, 
574 (1, 2, 4-7), 577 (16-19, 21-30, 
32-35) 

derivatives of the, 582 (37, 38) 
duplication formula for the, 581 (36) 
infinite product for the reciprocal, 565 
product formula for the, 582 (42, 43) 
Stirling’s formula for the, 558, 566 
Gauss’s definition of the Gamma func¬ 
tion, 565 

Gauss’s proof of the fundamental 
theorem of algebra, 175 
Gauss’s theorem on Gamma functions, 
583 (43) 

Gauss’s theorem on integrals, 387 (14) 
Gauss’s theorem on rational roots, 22 (18) 
Geometric representation, 10 
of complex numbers, 152 
of real numbers, 10, 18, 20 
Geometric series, 304 
Gibbs’ phenomenon, 511 (29) 

Goursat, 438 

Green’s theorem, 378, 384, 388 (22-27) 
Gronwall, 510 (28) 

Gudermannian function, 191 (28) 

Halphen, 147 (13, 14) 

Hamiltonian equations, 545 (32) 

Hardy’s convergence theorem, 512 (40) 
Hardy’s integration theorem, 469 (18) 
Harmonic series, 306 
Hartogs, 464 (*) 

Heine-Borel theorem, 14, 16, 19 
Higher derivatives, 109, 187, 334 
Homogeneous differential equations, 192 
(34), 540 (5) 

Homogeneous functions, 352 (12, 13) 
l’Hospital’s rule, 121, 130, 132, 134, 135 
Hyperbolic functions, 104, 167, 174 
expanded in powers, 576 (8-11) 

Fourier series for, 509 (22) 
inverse, 105, 172, 174 
Hypergeometric series, 328 (21, 22), 468 
( 12 ) 

4,151 

Imaginary component, 152 
Implicit functions, 50, 338, 540 (1, 2) 
Improper integrate, 271, 274, 297 (27) 


integration of, 403 

uniform convergence of, 397, 400, 420 
(28) 

Increasing functions, 36, 114, 256 
Increasing variables, 36 
Indefinite integrals, 202, 208 
Indeterminate forms, 121, 130, 132, 134, 
135 

Inequalities, 4, 6, 22 (9-11) 
and absolute values, 154, 156 
and integrals, 199, 435 
and limits, 30 
Inequality, Abel’s, 311 
Bessel’s, 491 

Schwarz’s 351 (9), 408, 421 (38) 
Infinite products, 319, 324, 390 
and Gamma functions, 565 
and ir, 578 (20) 

and trigonometric functions, 463, 473 
(48) 

Infinite series, 298, 390 
differentiation of, 405 
integration of, 401, 412 
positive, 302, 308 
Infinitesimals, 123 
Infinity, 26, 157 
not a number, 29 
orders of, 141 

points at, 189 (15), 235 (26) 

Integers, 1 

Integrable function, 195, 239, 358 
Integral test, 303 
Integrals, 194, 239, 264, 356, 433 
analytic, 448, 502 
complete, 538, 545 (31, 34) 
complex, 433 

containing a parameter, 347, 448 

cosine, 218, 573 

definite, see Definite integrals 

Dirichlet, 579 (23-28) 

double, 356 

elementary, 217 

exponential, 218, 238 (45), 571 

Fourier, 493, 496 

Fresnel, 218, 574 

improper, see Improper integrals 

indefinite, 202, 208 

line, 290 

logarithmic, 218, 572 
multiple, 356, 367 
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Integrals, non-elementary, 218, 571 
Poisson, 511 (33-37) 
probability, 218, 573 
rationalizable, 216, 235 (23-30), 237 
(36-44) 
repeated, 359 

Riemann, 195, 239, 291, 356, 433 
sine, 218, 573 
Stieltjcs, 264, 289 
upper and lower, 239 
Integration, 194, 239, 264, 356, 433 
by parts, 209, 270 
by substitution, 209 
numerical, 228, 554, 577 (13) 
Interchange of order, 334, 360, 393, 398, 
403 

of differentiation, 334, 352 (14-16) 
of integration, 360, 398, 403, 420 (27, 
29-34), 448 
of limits, 393, 420 (27) 

Intermediate values, 45, 117 
Intervals, 11, 18, 20, 37 
Intrinsic coordinates, 374 
Inverse functions, 49, 99, 147 (16) 
analytic, 425, 471 (32-34) 
integration of, 217, 236 (33, 34) 
Inverse hyperbolic functions, 105, 172, 
174 

Inverse transformations, 354 (28), 425 
Inverse trigonometric functions, 90, 103, 
149 (31), 174 

Inversion, geometrical, 189 (15-17), 236 
(30) 

of operations, see Interchange of order 
Irrational numbers, 5 

Jacobian determinants, 341 
and functional dependence, 344 
and multiple integrals, 369 
and volumes, 371 

for composite transformations, 353 
(19), 369 

for conformal transformations, 428 
for inverse transformations, 354 (28), 
425 

positive and negative, 377 
Jacobi's partial differential equation, 545 
(32) 

Jordan's condition for integrability, 246 
Jordan's theorem on Fourier series, 485 


Rummer's criterion, 326 (5-8) 

Lagrange's multipliers, 353 (27) 
Lagrange's remainder in Taylor's 
theorem, 138, 141 

Laplace transforms, 503, 515 (50-52), 
580 (31) 

and differential equations, 504, 543 
(25) 

Laplace’s equation, 466 (1, 4), 474 (53), 
512 (37) 

Laplacian, 355 (32), 388 (22-27) 

Large O notation, 125, 142 
Laurent's series, 449, 470 (27-29) 

Law of finite increments, 114 
Law of signs, 3, 8, 22 (7) 

Law of the mean, 114, 192 (35) 
Lebesgue’s condition for integrability, 
254 

Lebesgue’s extension of Riemann's theo¬ 
rem, 480 

Lebesgue’s proof of Weierstrass’s theo¬ 
rem, 419 (24) 

Legendre’s duplication formula for 
Gamma functions, 581 (36) 
Legendre’s normal forms for elliptic in¬ 
tegrals, 219 

Legendre’s polynomials, 468 (11) 
Leibniz’s rule for integrals, 349 
Leibniz’s rule for products, 111 
Length of a segment in w-space, 350 (7) 
Length of arc, 278, 284, 294, 376 
an elementary function, 295 (15-21, 
24, 25) 

in curvilinear coordinates, 295 (10), 
354 (31-34) 

l’Hospital’s rule, 121, 130, 132, 134, 135 
Limit point, 11 
Limiting function, 390 
Limits, 24, 39 
complex, 156 

conditions for, 32, 35, 156 
greatest and least, 33 
inequalities and, 30 
infinite series and, 301 
one-sided, 39 
sequence definition of, 34 
two-dimensional, 395 
upper and lower, 30 
Line integrals, 290 
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Linear difference equations, 193 (41-44) 
linear differential equations, 542 (13-25) 
first order, 543 (19) 
homogeneous, 192 (34) 

Laplace, 466 (1, 4), 474 (53), 512 (37) 
Laplace transforms and, 504, 543 
(25) 

partial, 535, 544 (30) 
second order, 544 (27, 28, 33) 
systems of, 543 (24, 25) 
with constant coefficients, 191 (31-33), 
504, 543 (23, 25) 

Linear properties of integrals, 197 
Iipschitz conditions, 205, 263 (20), 415, 
484,522 

Logarithmic function, 57, 63, 71, 168 
as a limit, 94 (20), 234 (16) 
computation of the, 149 (35) 
differentiation of the, 70, 101, 173 
not algebraic, 144 
order of the, 143 

Taylor's expansions for the, 149 (33, 
34) 

Logarithmic integral, 218, 572 
Lower bound, 13 
Lower integral, 239 

Maclaurin, 138, 554, 576 (12) 

Mass, 286 

center of, 188 (2), 288 
Mathematical induction, 1 
Maxima and minima, 45, 116, 353 (25- 
27) 

Mean convergence, 407 
of Fourier series, 490 
Mean value theorem, 112, 120, 201, 311, 
336, 365 

Bonnet's, 311, 329 (26, 28) 
for derivatives, 112, 120, 192 (35), 
336 

for integrals, 201, 311, 365 
Measure, 249, 253 
Mechanics, laws of, 287, 289 
Moment of inertia, 288 
Monotonic functions, 36, 115, 255 
Monotonic variables, 36 
Morera’s theorem, 443 
Jf-test for uniform convergence, 399 
# Multiple integrals, 356, 367 
Multiply connected region, 430 


Natural logarithms, 70 
Necessary conditions, 32 
Negative numbers, 3, 9 
Nested intervals, 37 

Newton's method of approximation, 148 
(23, 24) 

Non-differentiable continuous function, 
146 (10) 

Non-elementary integrals, 218,571 
Non-uniform approach, 392, 418 (15) 
Normal direction, 351 (8), 371 
n-space, 20, 350 (4-9), 367 
n-tuple integrals, 367 
Numbers, 1, 151 
algebraic, 54 (26-34), 263 (14) 
complex, 151 
integral, 1 
irrational, 5 
negative, 3, 9 
rational, 2 
real, 1, 6 

transcendental, 56 (34), 263 (15) 
Numerical integration, 228, 554, 577 (13) 
Numerical value, 5, 23 (28), 153 

o and O notation, 124, 142 
Odd functions, 233 (2), 493 
Open intervals, 11, 20 
Open regions, 21, 47 
Operational methods, 111, 144, 191 (33), 
504, 551, 577 (12, 13) 

Order in a number system, 4, 6 
Orders of infinitesimals, 123 
Orders of infinity, 141 
Orthogonal curvilinear coordinates, 354 
(30-34), 387 (9, 10), 467 (6) 
Oscillation of a function, 41 
at a point, 245 
Osgood, 464 (*) 

IP function, 227, 278 
Parseval's theorem, 492 
Partial derivatives, 331, 335 
Partial differential equations, 528, 534, 
538 

Cauchy-Eiemann, 423, 467 (5-7) 
Clairaut, 545 (31) 

Hamilton-Jacobi, 545 (32) 

Laplace, 466 (1, 4), 474 (53), 512 (37) 
linear, 535, 544 (30) 
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Partial fractions, 181, 186 
Peano’s non-differentiable function, 146 
( 10 ) 

Peano’s space-filling arc, 56 (35) 

Periodic functions, 233 (6, 7), 475 
Perpendicularity in w-space, 350 (7) 

Pi, t, 23 (29), 81, 149 (32), 578 (20) 
Point sets, 11 

Poisson's integral, 511 (33-37) 

Poisson's sum formula, 514 (48, 49) 
Polar coordinates, 91, 295 (10), 467 (5, 7) 
in space, 355 (33, 34), 387 (10) 

Pole, 452 

Polygonal line, 279 
Polynomials, 175, 178 
real, 184 

Positive infinite products, 322 
Positive infinite series, 302, 308 
Power functions, 57, 64, 170 
Power series, 429, 446, 468 (13-16, 18) 
differentiation of, 431 
integration of, 436, 469 (16, 18) 
see also Laurent’s series and Taylor’s 
expansions 

Practical tests for convergence, 308, 319 
Probability integral, 218, 573 
Products, see Infinite products and Signs 
of products 

Quadratic equations, 189 (6, 11) 

Radian measure, 84 
Radius of convergence, 431 
Rational functions, 179 
expanded in powers, 182, 470 (28, 29) 
expansions involving, 461 
integration of, 213 

partial fraction decomposition of, 181, 
186 

Rational numbers, 2 
Rational roots of polynomials, 22 (18) 
R&tionalizable integrals, 216, 235 (23- 
30), 237 (36-44) 

Real component, 152 
Real numbers, 1, 6 

decimal and binary fractions for, 53 
(13-15) 

Region, 21 
closed, 47 
connected, 337 


multiply connected, 439 
open, 21, 47 
simply connected, 438 
Remainder theorem for polynomials, 178 
Repeated integrals, 359 
Residues, 453, 470 (30) 
definite integrals and, 456, 471 (38-47) 
Ricatti’s differential equation, 544 (27,28) 
Riemann, 423, 467 (5-7) 

Riemann integrals, 195, 239, 291, 356,433 
improper, 271, 274 
Riemann sums, 195, 268, 356, 433 
Riemann’s theorem on analytic func¬ 
tions, 452 

Riemann’s theorem on trigonometric in¬ 
tegrals, 480 
Rolle’s theorem, 111 

Schloemilch’s remainder in Taylor’s 
theorem, 141 

Schwarz’s inequality, 351 (9), 408, 421 
(38) 

Separable differential equations, 210, 540 
(3, 4) 

Sequences, 24, 390 
definition of limits by, 34 
differentiation of, 407 
integration of, 401, 409 
of functions, 390 
of numbers, 24 
uniformly convergent, 392 
Series, 298, 390 
alternating, 315 
differentiation of, 405 
Fourier, see Fourier series 
geometric, 304 
harmonic, 306 
infinite, 298, 390 
integration of, 401, 412 
Laurent, 449, 470 (27-29) 
positive, 302, 308 
power, see Power series 
Taylor’s, see Taylor’s expansions 
Several variables, functions of, 46 
analytic, 464, 474 (52-54) 
continuous, 47 

Signed elements of area and volume, 
376 

Signs of products, 3, 8, 22 (7) 

Signum function, 94 (22) 
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Similarity transformation, 189 (14), 427 
Simply connected region, 438 
Simpson’s rule, 232, 577 (13) 

Sine and cosine, see Trigonometric func¬ 
tions 

Sine integral, 218, 573 
Singular point, 451 

Singular solutions, 541 (9-12), 544 (29) 
Small o notation, 124, 142 
Specific force, 288 
Sphere in nnspace, 21, 580 (27, 28) 
Stieltjes integrals, 204, 289 
improper, 272 
Stiiiing’s formula, 558, 566 
Stokes's theorem, 382 
Sufficient conditions, 32 
Sum formula, 511 (33-37), 554, 576 
(12) 

Summability, Ces&ro, 486, 512 (38-41) 
Surface area, 371, 377, 387 (11, 12) 
Sylvester's dialytic method, 55 (27) 

Tangent hyperplane, 350 (5) 

Tangent line, 112, 120, 147 (11), 350 
(3, 4) 

Tangent plane, 350 (6), 371 
Taylor's expansions, 125, 137, 442 
bounds for coefficients in, 469 (20) 
differentiation of, 129, 431 
for analytic functions, 442, 465 
for composite functions, 129, 446 
for finite increments, 137, 141 
for infinitesimal increments, 125, 128, 
147 (19) 

for several variables, 337, 466 
integration of, 129, 149 (30), 436 
not approximating a function, 150 (41) 
remainders in, 138, 141 
Test ratio, 305, 308, 319 
Tmusoendental numbers, 56 (34), 263 (15) 
Transformations, 189 (13), 235 (26), 369, 
425 

affine, 426 

bilinear, 190 (18-20) 
confo rmal , 425 
inverse, 354 (28), 425 
mmilArity, 189 (14), 427 
Trapesoidal rule, 230, 554 

functions, 57, 75* 85, 163, 


differentiation of, 90,103 
expanded in powers, 128, 148 (27, 28), 
474 (51), 482, 576 (8-11) 
expanded in rational fractions, 463, 
509 (24) 

Fourier series for, 509 (23) 
infinite products for, 463, 473 (48) 
inverse, 90, 103, 149 (31), 174 

Unieursal curve, 235 (23-30) 

Uniform continuity, 42 
Uniform convergence, 392 
integration and, 402, 435 
Af-test for, 399 
of analytic functions, 445 
of Fourier series, 485 
of improper integrals, 397, 400, 420 
(28) 

of power series, 430 
Upper bound, 14 
Upper integral, 239 

Variables, 24, 156, 422 
becoming infinite, 26, 141, 157 
change of, 209, 335, 368, 455, 465 
complex, 151, 156, 422, 444, 464 
functions of, see Functions 
limits of, see Limits 
monotonic, 36 
sequences of, 24, 390 
several, 46, 464 
Variation, 256, 282 

functions of bounded, 256, 260, 263 
(20, 21), 282 
of a function, total, 257 
of parameters, 542 (17-23, 25) 

Vectors, 152 

acceleration, 193 (45, 46), 295 (14) 
in w-space, 350 (7) 
representing complex numbers, 152 
velocity, 193 (45, 46) 

Velocity, 193 (45, 46) 

Volume, 367, 377, 387 (9, 10) 

Wallis's product for 578 (20) 
Weieretrass, 12, 18, 146 (10) 
Weierstrass's approximation theorem! 

419 (24), 489 
Weierstrass's Af-test, 399 
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Weierstrass’s P function, 2127, 278 
Weierstraes's product for the reciprocal 
Gamma function, 565 
Work, 292 

Wronskian determinants, 146 (7-9), 238 
(46), 542 (13-16) 


Zero, 3 

content, 244, 359 
measure, 250 
no division by, 4, 22 (8) 
of a polynomial, 175, 179 
of an analytic function, 452 





